Senior Data Engineer

  • Location

    Richmond upon Thames, London

  • Sector:


  • Job type:


  • Salary:

    £600 - £800 per day

  • Contact:

    Harriet Hughes

  • Contact email:

  • Job ref:


  • Published:

    4 months ago

  • Expiry date:


  • Client:


Senior Data Engineer, Data Model, Web Service, Data Files, Database, MS SQL, Prototype, Evaluate, Service Enhancements, Data-Driven, Release Cycle, Data Migration, Architecture, Architectural, Graph-Based, Linked Data, SPARQL, Cypher, ETL, IAM, Cloud, SHACL, Graph Data, Digital File Formats, Wikidata, Preservation Action Registry.

A data engineer is required to develop a new data model and web service, with associated services for regularly updating data files. The core aims are to modernise the database infrastructure/technology (currently based on MS SQL), to refine the data model, to extend the signature vocabulary, and to facilitate better linking and data sharing with external data sources, in particular Wikidata and the Preservation Action Registry. Work will also be required to update the web application and bring it into line with the current brand.

- Rapidly prototype/evaluate different models and approaches so we can understand the feasibility of our requirements.
- Create/demonstrate prototype features to users and stakeholders.
Implement data model and service enhancements according to agreed design.

Key Skills / Experience
· Highly experienced Senior Data Engineer (or Senior Software Engineer) with excellent track record of designing/creating/iterating/testing data models, working with production data, delivering resilient, data-driven services into live environment
· Have excellent experience of implementing data models for use in live systems environments,
· Have the ability to manage all aspects of the release cycle, including migration of existing data
· Have an excellent knowledge of architectural approaches that are relevant to this work - you should identify appropriate approaches in your response.
· Experience, knowledge and understanding of graph-based data models and of modelling graph data, including experience, knowledge and understanding of graph/linked data querying languages, such as SPARQL or Cypher
· Experience, knowledge and understanding of Extract, Transform, Load (ETL) processes
· Experience, knowledge and understanding of creating resilient and secure systems using IAM in a cloud context
· Experience, knowledge and understanding of validating graph data with SHACL
· Demonstrate an ability to deliver high quality work to a fixed timeline and budget
· Have knowledge and experience of digital file formats and their identification and characterisation.