Python Data Engineer: Python, AWS, Airflow

Location:
London
Job Type:
Contract
Industry:
Cloud & Infrastructure
Job reference:
BBBH130938_1611900289
Posted:
27 days ago

Python Data Engineer: Python, AWS, Airflow

Python Data Engineer: Python, AWS, Airflow

The work location is based in London / Initially working from home

5 Month Contract

Pay rate is between £550 - £600 Per Day

Skills Required

  • Must have extensive coding experience in Python
  • Excellent Data knowledge
  • Self-motivated and creative. We're building from ground up, not tweaking legacy
  • Good communicator and team player
  • Solid understanding of algorithms and data structures
  • Proficiency in scripting languages (especially Python)
  • Experience of cloud platforms (e.g. Amazon Web Services)
  • Commercial experience of writing and optimizing SQL queries
  • Experience of data orchestration platforms (e.g. Airflow)

An ideal candidate (is not required to, but) will also have:

  • Experience in feature engineering for Machine Learning applications
  • Knowledge of data versioning libraries/ methods (e.g. DVC)
  • Familiarity with data lakes
  • Experience of cloud data warehouses (e.g. Snowflake)
  • Familiarity with migrations frameworks for change management (e.g. Flyway, Alembic)
  • Experience of dynamic schemas/schemas evolution
  • Experience building streaming pipelines (e.g. Kafka, Kinesis)
  • Familiarity with continuous deployment
  • Experience ingesting data from web (e.g. HTTP requests, HTML/ XML parsing)
  • Familiarity with Big Data ecosystem (e.g. Spark/ MapReduce)
  • Experience of load testing data pipelines
  • Experience of geo-indexing technologies (e.g. PostGIS)
  • Knowledge of columnar data storage formats (e.g. Parquet, ORC)
  • Experience working within an agile team

If you are relevant or interested don't delay, contact me on 0161 924 1416 or email me at

Back to Search Results