Senior Data Engineer

  • Location:

    City of London, London

  • Sector:

    IT

  • Job type:

    Permanent

  • Salary:

    £55000 - £84000.00 per annum + Pension

  • Job ref:

    BBBH107885_1564490156

  • Published:

    27 days ago

  • Start date:

    ASAP

  • Client:

    Undisclosed Company

Senior Data Engineer

£55,000 - £84,000 + Excellent pension

Central London

Data Engineer / Data Developer / Data / Data Science / Big Data / Azure / Hadoop / Hive / SQL / Python

Working for a Government funded regulatory body who are using cutting edge data focused technology, the successful candidate will have the opportunity to work in a well funded and talented Data Services team.

The Senior Data Engineer will responsible for the construction of data products for the business delivering new functionality to the Data Services platform. You will engage in discussion with technical design leads and other technical staff, recommending options for implementing technical infrastructure and future data products.

Responsibilities:

  • Facilitate the end-to-end data handling approach of Data Pieplines through the Data Services platform (defining and communicating technical needs for data collection, ingestion, transformation and calculation)
  • Assure that your work and the work of colleagues meets governing standards
  • Ensure principles of privacy and security are assessed and designed into your data solutions
  • Encourage teamwork and communication, especially between Data Engineers, Quality Assurance and Subject Matter Experts
  • Follow Agile methodologies
  • Be knowledgeable about the portfolio of data journeys
  • Provide succinct documentation to support knowledge retention and training
  • Be supportive and open to junior members of the team

Skills / Abilities:

  • Advanced knowledge of software design principles
    • Data development process
    • Data integration design
    • Programming and build
    • Technical understanding
  • Knowledge of data management, handling and processing
    • Data Quality
    • Data Preparation
    • Data Cleansing
    • Data Modelling
    • Experience working with and integrating into Business Intelligence tools

  • Hands on experience in platforms such as Azure and the Hadoop ecosystem (HIVE, HDFS and Apache spark)
  • Advanced competency with Python and SQL
  • Knowledge of Linux




Apply Save job Create Job Alerts

Share this job