Lead Data Engineer

  • Location

    Southend-On-Sea, Essex

  • Sector:


  • Job type:


  • Salary:

    £500 - £530 per day

  • Contact:

    Thomas Hunt

  • Contact email:


  • Job ref:


  • Published:

    6 months ago

  • Duration:

    6 Months

  • Expiry date:


  • Start date:


Job Title - Lead Data Engineer
Location - Southend
Duration - 6 months

**In scope of IR35**

Would you like to join a global leader in consulting, technology services and digital transformation?

Our client are at the forefront of innovation to address the entire breadth of opportunities in the evolving world of cloud, digital and platforms.

You will be based on site working with one of the UK's most digital organisations and leading the technology revolution across the public sector. With over 50 million customers at the heart of everything they do the scope and impact of your work is limitless. As a team, they're not afraid to try new technologies and new ways of working.

Role description -

As a lead ETL Developer, you will be responsible for developing code to deliver accurate, efficient data solutions which meet customer needs to agreed timescales.

Task description -

  • You will ensure the stability, robustness and resilience of the products you build, and be in a position to affect changes to these products where necessary.
  • Translate customer requirements to develop effective, robust solutions in line with build standards and are production ready.
  • Produce comprehensive test scripts to ensure code quality.
  • Define version control mechanisms and strategies for the source code of the product.
  • Collaborate across teams and liaise with Senior Data Engineers and Technical architects to investigate technical solutions.
  • Responsible for maintaining the support and implementation of continuous improvement to build standards.
  • Developing automated data ingest routines, workflows and mappings for structured and unstructured data.

Technologies -

  • In-depth working of one or more of the following - informatica, PLSQL, Unix, Hbase, Hive, Spark, MongoDB, Postgres
  • Extensive working knowledge and experience with TEL/Data integration
  • UNIX shell scripting
  • SQL databases

Mandatory Technical Skills -

  • Hands-on experience of database architecture, relational database diagrams and integrity constraints.
  • Knowledge of data reconciliation, ETL error handling, error logging mechanisms using best practice
  • Significant and demonstrable experience implementing Data Engineering standards
  • Knowledge and understanding of producing unit-test scripts and version control methodologies
  • Significant and demonstrable knowledge of SQL databases.
  • An in-depth understanding of ETL concepts, ETL loading strategy, Data archiving, Data reconciliation, Data manipulation, ETL Error handling, Error logging mechanism, standards and best practice with hands-on experience in developing ETL solutions.
  • An ability to quickly comprehend and convert business requirements into technical solutions.
  • Good working knowledge of Data Warehouse techniques for dimensional data modelling, relational database design, ETL techniques and data analysis.

Mandatory Business Skills -

Experience of leading data engineers in complex, multi-disciplinary environment, delivering products within specific time-scales and engaging with multiple senior stakeholders

The successful candidate will hold active SC clearance, or be eligible and willing to undergo the relevant checks.
Please submit CVs in the first instance.