Role Title: Data Engineer
Duration: contract to run until 31/10/2025
Location: Birmingham, Hybrid
Rate: up to £414 p/d Umbrella inside IR35
Key Skills/ requirements
- Strong DevOps engineering background
- CICD pipeline
- Git / Github
- Github actions / hooks
- Jenkins
- SonarQube
- Linux, e.g. Redhat
- Groovy / Bash / Python scripts
- Nexus
- Good understanding of Python library and application development
- Dependency management and package management, e.g. Poetry, pip
- Pandas and numpy
- API, e.g. Flask, Dash
- IDE (Pycharm, VsCode) and remote development
- Good understanding of Data engineering
- ETL / ELT pipeline
- Spark
- Airflow
- SQL / no-SQL
- Delta lake
- Parquet
- Avro
- Partitioning
- Starburst
- S3 bucket
- Postgres
- MLFlow
- Experience in Cloud and Containerization
- GCP / Internal cloud
- Docker / Kubernetes
- Argo CD
- Monitoring tooling, e.g. ELK
- Service Mesh, e.g. Istio
- Experience in secrets management, e.g. Vault
- Good understanding of networking, security and operating system
- TCP/IP
- DNS
- SSH
- SSL/TLS
- Encryption and tokenization
- CPU and memory management
- Experience of supporting Big Data infrastructure
- Hadoop cluster
- Spark cluster
- JDK/JVM
- Cloudera
- Strong problem solving and troubleshooting skills
- Take ownership and able to work independently
- Able to work under high pressure and in fast-paced environment.
- Good at documentation and knowledge sharing
- Able to communicate and work with multi-region / multi-cultural teams
All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to respond to successful applicants in the first instance. We thank you for your interest and the time taken to apply!
