Data Engineer

Location:
Ipswich, Suffolk
Job Type:
Contract
Job reference:
BBBH131231_1608744043
Posted:
about 1 month ago

Data Engineer

Ipswich (Remote)

2 Months + Extension

£300 - £400 per day

Contract

My client are a leading telecoms company who are on the lookout for experienced data engineers who have experience using Cloudera (HDFS, Spark, Kafka, Hive, Impala, HBase). As a data engineer you will be tasked with building, deploying and managing data ingestion pipelines using Cloudera.

As a Data Engineer you will…

  • Performing a multi-skilled role you'll need to have experience building, deploying and managing data ingestion pipelines using Cloudera (HDFS, Spark, Kafka, Hive, Impala, HBase) and Elasticsearch technologies.

  • The role will also involve some software development, so development skills in Java/Scala and scripting languages such as Python or bash scripting would be desirable.

  • Experience of security protocols such as TLS, SAML2 and Kerberos would be advantageous.

  • You should have an analytical and problem-solving mindset.

  • You'll need to be capable of quickly understanding new technologies and establishing best practice for their use.

  • You'll work with users to understand their requirements and then design, develop and configure solutions using the appropriate architectural components.

  • You may be required to integrate and configure COTS (Commercial Off-The Shelf) products. You may need to support out of hours software deployments.

  • You'll also provide in-life support for investigation and resolution of application problems.

  • As an experienced DevOps practitioner, you will be expected to provide an analytical and innovative input to projects, within a clear framework of accountability. As well as being competent in your own area, you will also assist in the definition of strategy and process improvements.

Essential skills and experience

  • Cloudera - HDFS, Spark, Kafka, Hive, Impala, HBASE

  • Elasticsearch/Kibana

  • Pipeline release automation using Puppet, Jenkins, GITLAB or similar

  • Experience working in a Linux environment (including system administration fundamentals)

Desirable

  • Core software engineering skills (demonstratable industrial experience)

  • Scripting skills in bash and python

  • Programming languages e.g. Java/Scala (demonstratable industrial experience)

  • Experience with automated test frameworks e.g. JUnit, Cucumber

  • Security technologies e.g. SSO integration, SAML2, Kerberos

  • Containerisation (e.g. Docker, Kubernetes)

If this is of interest to you then apply today for immediate consideration! Please note that this role is completely remote under current restrictions but if measures do ease it will be based onsite in Ipswich.

Back to Search Results
Similar jobs
  • Contract

    Senior Data Engineer: Python, AWS, Airflow, Athena

    London, England

    Posted December 14, 2020

    Read more
  • Contract

    Senior Data Engineer: Python, AWS, Airflow, Athena

    London, England

    Posted January 5, 2021

    Read more
  • Contract

    Flight Physics Engineer - Helicopters

    Salisbury

    Posted January 22, 2021

    Read more
  • Contract

    Flight Physics Engineer - Helicopters

    Salisbury, Wiltshire

    Posted January 13, 2021

    Read more
  • Contract

    ILS Engineer

    Basingstoke, Hampshire

    Posted January 12, 2021

    Read more
  • Permanent

    Software Engineer

    Birmingham, West Midlands

    Posted January 5, 2021

    Read more
  • Contract

    Project Cost Engineer

    Plymouth, Devon

    Posted January 12, 2021

    Read more
  • Contract

    Information Architect

    London, England

    Posted January 6, 2021

    Read more
  • Contract

    Production Engineer

    Stevenage, Hertfordshire

    Posted January 6, 2021

    Read more