Data Engineer
Ipswich (Remote)
2 Months + Extension
£300 - £400 per day
Contract
My client are a leading telecoms company who are on the lookout for experienced data engineers who have experience using Cloudera (HDFS, Spark, Kafka, Hive, Impala, HBase). As a data engineer you will be tasked with building, deploying and managing data ingestion pipelines using Cloudera.
As a Data Engineer you will…
Performing a multi-skilled role you'll need to have experience building, deploying and managing data ingestion pipelines using Cloudera (HDFS, Spark, Kafka, Hive, Impala, HBase) and Elasticsearch technologies.
The role will also involve some software development, so development skills in Java/Scala and scripting languages such as Python or bash scripting would be desirable.
Experience of security protocols such as TLS, SAML2 and Kerberos would be advantageous.
You should have an analytical and problem-solving mindset.
You'll need to be capable of quickly understanding new technologies and establishing best practice for their use.
You'll work with users to understand their requirements and then design, develop and configure solutions using the appropriate architectural components.
You may be required to integrate and configure COTS (Commercial Off-The Shelf) products. You may need to support out of hours software deployments.
You'll also provide in-life support for investigation and resolution of application problems.
As an experienced DevOps practitioner, you will be expected to provide an analytical and innovative input to projects, within a clear framework of accountability. As well as being competent in your own area, you will also assist in the definition of strategy and process improvements.
Essential skills and experience
Cloudera - HDFS, Spark, Kafka, Hive, Impala, HBASE
Elasticsearch/Kibana
Pipeline release automation using Puppet, Jenkins, GITLAB or similar
Experience working in a Linux environment (including system administration fundamentals)
Desirable
Core software engineering skills (demonstratable industrial experience)
Scripting skills in bash and python
Programming languages e.g. Java/Scala (demonstratable industrial experience)
Experience with automated test frameworks e.g. JUnit, Cucumber
Security technologies e.g. SSO integration, SAML2, Kerberos
Containerisation (e.g. Docker, Kubernetes)
If this is of interest to you then apply today for immediate consideration! Please note that this role is completely remote under current restrictions but if measures do ease it will be based onsite in Ipswich.
