Accessibility Links

Big Data Developer - Central London

  • Salary: £550 - £620 per day
  • Job type: Contract
  • Location: City of London, London
  • Sector: Web Development
  • Date posted: 20/06/2018
  • Job reference: J388346A

We're really sorry, but it looks like this job has already been filled.

Register your CV with us, see our latest jobs or use the search below.

I am currently recruiting on behalf of one of the world's largest travel company for a big Data Developer to handle the mass amounts of data produced. They produce Terabytes of data every single day with a Data Lake measured in Petabytes and it is growing rapidly each day.
Working in our new data platform team you will be a key member of the data pillar responsible for supporting and developing our existing AWS data platform solutions to enable our team of analysts to report as well as explore and fully leverage our data assets.
We are looking for a highly motivated, disciplined big data engineer with proven understanding & experience on big data technologies such as Hadoop, Spark, Hive, Teradata.
You will have a real passion for innovation and an appetite to challenge existing thinking. You will be a great communicator equally comfortable with discussing and explaining technical problems and solutions with analysts & engineers.

Role Description
* Set up & maintaining of Big data analytics applications in cloud such as EMR, RedShift, Qubole, R Studio and more.
* Developing tools to automate usage monitoring, system health, executing upgrades and building multi-region cloud solutions for these applications.
* Working with vendors to fix platform performance and stability issues.
* Help users with training & best practices to write efficient queries & processes to analyse the data in the most efficient & performant manner
* Evaluate new tools & technologies in cloud.
* Collaborate in program & system architecture discussions to identify a suitable quality solution to the business requirement.
* Implement suitable architecture to provide maximum efficiency and cost optimization.
* Strong knowledge & experience of configuring, optimizing & supporting production Hadoop platforms
* Deep understanding & expertise in writing and optimizing Hive & Spark queries and jobs
* Application support experience
* Experience in Java, SQL, R & Scripting (Python or Shell)
* Experience with building monitoring around tools availability, usage & performance
* Experience working with Cloud is desirable; AWS, GCP
* Automation tooling such as Terraform would be beneficial.

Why join for this client?
* You will get to work with spectacular people across technology, product & business teams.
* You will live, breathe, craft data solutions on top of petabyte scale data lake and the latest big data technologies.
* We believe in leading humbly & create a supportive, collaborative, and fulfilling place where you can progress your career.
* We have many best bits of a start-up backed by resources of the world's biggest travel company
* We love open source and actively participate in the open source community
* We do hackathons at multiple scales to drive innovation
* We host and speak at meet ups
* We want everyone in our teams to have the tools and resources to succeed in their career
* We get to do all of this in a fun, modern office with great perks, in a desirable part of London

If this sounds like the ideal position for you then please click apply where I will be in touch as soon as possible to discuss your application in more detail.

Similar jobs
View more similar jobs