Principle Data Engineer

  • Location

    Coventry, West Midlands

  • Sector:

    IT

  • Job type:

    Permanent

  • Salary:

    £70000 - £85000.00 per annum + Bonus

  • Contact:

    Luke Byrne

  • Contact email:

    Luke.Byrne@experis.co.uk

  • Job ref:

    BBBH108551_1565357336

  • Published:

    4 months ago

  • Expiry date:

    2019-09-08

  • Start date:

    ASAP

  • Client:

    #

Principle Data Engineer (Big Data)

Up to £85,000 + Bonus

Coventry

Data Engineer / Data Developer / Hadoop / Spark / Big Data / Python / SQL / Java / C# / R

Working for a large-scale Energy / Utility's company who are recognised by all. The successful candidate will have the opportunity to work in a well funded and talented Data team who are using cutting edge data tools, technologies and techniques.

You will work closely with our Data Analysts and Data Scientists to identify source system data, ingest, clean, transform and enrich these data to construct curated versions of truth to drive our analytical and modelling approach.

Pipelines are constructed with Spark, Python, Scala, sqoop or traditional SQL and will leverage cloud infrastructure such as AWS, StreamSets and Databricks. You are expected to be nimble and creative when it comes to solving the problem at hand and eager to learn and implement new technologies.

To derive insight from unconnected and unexploited data silos you will need to extract and combine information from a vast array of disparate data sources such as: Data Warehouses, operational relational databases, legacy applications, unstructured data, graph databases, documents, emails, APIs, Kafka endpoints and NoSQL databases.

Responsibilities

  • Responsible for building infrastructure and architecture to support gathering, preparing and publishing data from complex and varied data sources to deliver new insights to enable rapid, high quality innovation
  • Help drive and implement the data engineering strategy, working with the D&I leadership team to define technology direction
  • Work with your team and other Principals collaboratively to define and implement technical standards and improvements
  • Be accountable for the overall delivery and quality of projects including the design and code review process and engineering discipline across projects in your area
  • Be seen as the go-to senior person for multiple aspects of the technical stack
  • Line management of one or more data engineers
  • Provide coaching/mentorship to other members of the team when needed
  • Promote agile/engineering craftsmanship best practices and a culture of innovation

Skills

  • Experience in Big Data technologies - Hadoop / Spark / NoSQL DBs
  • Development background in 2 of the following - Java / Scala / Python / C# / R / SQL
  • Experience with ETL tools
  • Data Warehouse experience
  • Great communication skills, both verbal and written
  • Excellent attention to detail