Senior Data Engineer: Python, AWS, Airflow, Athena
Senior Data Engineer: Python, AWS, Airflow, Athena
The work location is based in London / Initially working from home
5 Month Contract
Pay rate is between £550 - £600 Per Day
Skills Required
Self-motivated and creative. We're building from ground up, not tweaking legacy
Good communicator and team player
Solid understanding of algorithms and data structures
Proficiency in scripting languages (especially Python)
Experience of cloud platforms (e.g. Amazon Web Services)
Commercial experience of writing and optimizing SQL queries
Experience of data orchestration platforms (e.g. Airflow)
An ideal candidate (is not required to, but) will also have:
Experience in feature engineering for Machine Learning applications
Knowledge of data versioning libraries/ methods (e.g. DVC)
Familiarity with data lakes
Experience of cloud data warehouses (e.g. Snowflake)
Familiarity with migrations frameworks for change management (e.g. Flyway, Alembic)
Experience of dynamic schemas/schemas evolution
Experience building streaming pipelines (e.g. Kafka, Kinesis)
Familiarity with continuous deployment
Experience ingesting data from web (e.g. HTTP requests, HTML/ XML parsing)
Familiarity with Big Data ecosystem (e.g. Spark/ MapReduce)
Experience of load testing data pipelines
Experience of geo-indexing technologies (e.g. PostGIS)
Knowledge of columnar data storage formats (e.g. Parquet, ORC)
Experience working within an agile team
If you are relevant or interested don't delay, contact me on 0161 924 1416 or email me at