Accessibility Links

Big Data Development Lead

  • Salary: Negotiable
  • Job type: Contract
  • Location: London
  • Sector: IT
  • Date posted: 17/07/2017
  • Job reference: J370461A
This vacancy has now expired.

Big Data Development Lead

London (Croydon)

24 months


SC Cleared

Job Summary:

  • New transformational program for a UK customer focusing on Big Data and advanced visualization capabilities
  • We are seeking a talented and passionate Big Data Lead with experience in Hadoop with a deep understanding of Object-Oriented design and extensive experience in Java, Big Data and Hadoop technologies.
  • We are looking for expertise in Java, Scala, Kafka, Samsa, HBase, HDFS (preferably Hortonworks Distribution) and Python with a focus on distributed, highly scalable and high performance computing.
  • The role requires a Big Data Lead to work along with Big Data Engineer to work on the continuing design, build and commission and test of our clients Big Data Platform.
  • SC Clearance or being eligible for SC clearance or CTC clearance

Key Responsibilities:

  • Manage team between 10-20 people
  • Develop Data Ingestion Pipelines with Java/Scala, Kafka, Samsa and HBase.
  • Agile Development
  • 3rd Line Support
  • Continuous Integration
  • Unit Testing & Documentation

Job Requirements:

Essential Skills:

  • Past experience of managing Big Data team
  • Hadoop/HDFS (Hortonworks Distribution)
  • HBase, Kafka, Kerberos, Drools
  • Graph DBs (Ideally Datastax Enterprise, TinkerPop, Gremlin)
  • Big data architecture, Real Time data processing, Spark, Kafka, Samsa
  • Solr
  • Java 8
  • Scala
  • ZooKeeper
  • Spring/Spring Boot and spring data rest
  • REST
  • TDD
  • BDD (specifically Cucumber)
  • Strong Communications Skills
  • Microservices architecture
  • Experience working within a Scrum team and be familiar with
  • CI development techniques and environments.
  • AWS Cloud

Nice to Have Skills:

  • Oracle, Postgres
  • Apache Camel, Knox, Ranger
  • Enterprise Integration Patterns
  • Kubernetes
  • Docker
  • Ansible, Terraform
  • JIRA
  • Confluence
  • Experience in Dynamo DB and nice to have Datastax Graph, Gremlin
  • Government experience
  • Knowledge of networking, DevOps,
  • Enterprise Business Intelligence and Analytics
  • Demonstrate ability to develop, implement and maintain a set of Java-based operations and data services that provides a transactional and analytical platform.
  • This requires the use of
    • Open source frameworks and technologies such as Java 8, JBoss RESTEasy, Tomcat and Google Guice, and
    • CI and containerisation technologies such as Ambari, Puppet, Jenkins, Docker and Kubernetes
Similar jobs
View more similar jobs