Accessibility Links

Big Data Developer (DV Cleared)

  • Salary: £400 - £600 per day
  • Job type: Contract
  • Location: London
  • Sector: IT
  • Date posted: 13/10/2017
  • Job reference: J375694A

Big Data Developer, DV Cleared, DV Clearance, Data migration, Transformation, Quality, Modelling, Kafka, Hadoop, HBase, Map Reduce, Storm, Java, JMS, Public Sector, Government, London, XML, JSON, ETL

Big Data Developer (DV Cleared) - Central Government - London

Our central government department client based in London require a DV-Cleared Big Data Developer to work in the data migration team to identify source data requirements, assess data quality, map and specify the required transformations from the source to the target data, validate and perform trial data migration in production, cleanse data, and conduct a post implementation review of the data migration.

Specialist will be part of data architecture team working closely with the Enterprise Data Architect. Specialist will be required to work with multiple development teams and existing vendor to understand legacy and new data structures, develop migration routines, and perform data migration activities to migrate data from Oracle to Big Data Platform.

Specialist required to work in the data migration team to identify source data requirements, assess data quality, map and specify the required transformations from the source to the target data, validate and perform trial data migration in production, cleanse data, and conduct a post implementation review of the data migration.

Key Skills / Experience

  • Have demonstrable experience of successfully designing and implementing data migration, data transformation, data quality, modelling, testing and post production reviews.
  • Have demonstrable experience of mapping source and target data models, identify gaps, data cleansing, schema modelling (Relational/XML/JSON).
  • Have demonstrable experience of successfully delivering digital solutions that collect and manage personal and/or sensitive information with appropriate controls and protection.
  • Have demonstrable hands-on experience of Kafka, Big Data, Hadoop, HBase, Map Reduce, Storm, Java, JMS.
  • Have demonstrable experience of successfully and collaboratively working, coaching and sharing knowledge with Public Sector client teams, particularly those with limited agile development experience.
  • Have demonstrable experience of successfully design, implementation and migration of relational databases to Big data based data stores utilising Amazon AWS.
  • Have demonstrable hands-on experience using ETL, JMS, Apache Nifi, HDF, SAM.
  • Have exisiting, valid DV Clearance