Senior Data Engineer: Python, AWS, Airflow, Athena

  • Location:

    London, England

  • Sector:

    IT

  • Job type:

    Contract

  • Salary:

    £550 - £600 per day

  • Job ref:

    BBBH130938_1609857305

  • Published:

    12 days ago

  • Duration:

    5 Months

  • Start date:

    ASAP

  • Client:

    Undisclosed Company

Senior Data Engineer: Python, AWS, Airflow, Athena

Senior Data Engineer: Python, AWS, Airflow, Athena

The work location is based in London / Initially working from home

5 Month Contract

Pay rate is between £550 - £600 Per Day

Skills Required

  • Self-motivated and creative. We're building from ground up, not tweaking legacy
  • Good communicator and team player
  • Solid understanding of algorithms and data structures
  • Proficiency in scripting languages (especially Python)
  • Experience of cloud platforms (e.g. Amazon Web Services)
  • Commercial experience of writing and optimizing SQL queries
  • Experience of data orchestration platforms (e.g. Airflow)

An ideal candidate (is not required to, but) will also have:

  • Experience in feature engineering for Machine Learning applications
  • Knowledge of data versioning libraries/ methods (e.g. DVC)
  • Familiarity with data lakes
  • Experience of cloud data warehouses (e.g. Snowflake)
  • Familiarity with migrations frameworks for change management (e.g. Flyway, Alembic)
  • Experience of dynamic schemas/schemas evolution
  • Experience building streaming pipelines (e.g. Kafka, Kinesis)
  • Familiarity with continuous deployment
  • Experience ingesting data from web (e.g. HTTP requests, HTML/ XML parsing)
  • Familiarity with Big Data ecosystem (e.g. Spark/ MapReduce)
  • Experience of load testing data pipelines
  • Experience of geo-indexing technologies (e.g. PostGIS)
  • Knowledge of columnar data storage formats (e.g. Parquet, ORC)
  • Experience working within an agile team

If you are relevant or interested don't delay, contact me on 0161 924 1416 or email me at

Apply Save job Create Job Alerts

Share this job