Python Data Engineer: Python, AWS, Airflow
Python Data Engineer: Python, AWS, Airflow
The work location is based in London / Initially working from home
5 Month Contract
Pay rate is between £550 - £600 Per Day
Skills Required
- Must have extensive coding experience in Python
- Excellent Data knowledge
- Self-motivated and creative. We're building from ground up, not tweaking legacy
- Good communicator and team player
- Solid understanding of algorithms and data structures
- Proficiency in scripting languages (especially Python)
- Experience of cloud platforms (e.g. Amazon Web Services)
- Commercial experience of writing and optimizing SQL queries
- Experience of data orchestration platforms (e.g. Airflow)
An ideal candidate (is not required to, but) will also have:
- Experience in feature engineering for Machine Learning applications
- Knowledge of data versioning libraries/ methods (e.g. DVC)
- Familiarity with data lakes
- Experience of cloud data warehouses (e.g. Snowflake)
- Familiarity with migrations frameworks for change management (e.g. Flyway, Alembic)
- Experience of dynamic schemas/schemas evolution
- Experience building streaming pipelines (e.g. Kafka, Kinesis)
- Familiarity with continuous deployment
- Experience ingesting data from web (e.g. HTTP requests, HTML/ XML parsing)
- Familiarity with Big Data ecosystem (e.g. Spark/ MapReduce)
- Experience of load testing data pipelines
- Experience of geo-indexing technologies (e.g. PostGIS)
- Knowledge of columnar data storage formats (e.g. Parquet, ORC)
- Experience working within an agile team
If you are relevant or interested don't delay, contact me on 0161 924 1416 or email me at
