Senior Data Engineer, Hybrid working 1 day office, Senior Data Developer, Data Lead, Python, SQL, Scala, Azure, Big Data, ETL
My leading client is looking for x2 Senior Data Engineers to help them expand their data practise to drive the business to harness the power of data to championing the central Data Platform and Data Product adoption for all analytical needs. They are looking to grow the function across all level of Data experience
Technical Skills below
Salary - £70,000 to £80,000 per annum
- Strong Unix and shell scripting.
- Strong data concepts and data modelling principles (e.g. Normalisation (OLTP), Dimensional (DWH), Data Vault).
- Experience of building solutions on a Big Data distributed system (data lakes and data lakehouses).
- Strong software development background, with previous hands-on experience building data applications in
- Python, Scala on TDD/BDD approach and constant refactoring in continuous integration environment.
- Experience with building real-time pipelines, leveraging message brokering and stream processing technologies (Kafka, RabbitMQ, Flink, Spark Streaming).
- Experienced in building data applications in distributed data programming languages/frameworks such as Python, Scala, Apache Spark and Apache Flink.
- Commercial exposure working with and building solutions on cloud-based Big Data such as technologies like:
Storage: Blob Storage, S3, EFS
Processing: Spark, EMR, Data Factory, DataProc
Serving: Athena, SQLAnalytics, BigQuery, Hive, Presto, SQL Server, Synapse Analytics
Data Warehousing SaaS: Delta Lake, Snowflake, Redshift
Scheduling/Toolsets: Airflow, Control-M
Security: Kerberos, KMS, Anonymisation, Tokenisation
ELT: DataFactory , FiveTran, AWS Glue, NiFi
If this opportunity sounds like it could be of interest please send me your CV ASAP
