Our Central Government client require a Senior Data Lead with Data Science experience to spearhead an ongoing project.
The project:
A logical data warehouse is being built using data virtualisation to expose legacy data warehouses and new data stores to wider data consumers.
Designing and building ETL/ELT and Data streaming services to ensure data is available in various data warehouses and lakes for consuming by different exploitation business services.
Key skills and experience:
- Experience working with and leveraging the benefits of AWS and Microsoft Azure Cloud hosted services
- Experience working with ETL and ELT tools; namely Pentaho Data Integrator and/or Talend to design, create, deploy and operate enterprise services focusing on re-use, consistency and performance
- Experience Data Modelling and creation of physical models conformant with Enterprise Data Model and organisation standards
- Creating performant and resilient ETL/ELT jobs and Data Messaging pipelines for a large enterprise
- Experience working with Data Messages Queueing technologies, preferably Kafka
- Test driven development with Business Intelligence services including use of Continuous Integration environments
- Experience working with large databases and data lakes
- Experience working with public sector organisations
