Accessibility Links

Big Data Engineer

  • Salary: Negotiable
  • Job type: Permanent
  • Location: Ipswich, Suffolk
  • Sector: Business Intelligence
  • Date posted: 26/09/2017
  • Job reference: J374689A

My client based in Ipswich are currently looking to bring on an experienced, hands on Big Data Engineer. You will be designing, building and automating data pipelines extending the data platforms to meet the needs and requirements of stakeholders.

Responsibilities

  • Designing, developing and automating data pipelines extending the data platforms to meet the needs and requirements
  • Be the 'go-to' person in the team for Python developers, Spark, Hadoop ecosystem, and Cloudera specific tools.
  • Working in an Agile environment, organising and facilitating daily meetings, retrospectives, design and planning sessions and promoting team self-organisation
  • Data modelling and solution design on different data platforms

Qualifications and Experience

  • Strong experience in Data Ingestion, processing and performance tuning the Big Data platforms
  • ETL and Data Warehousing using Microsoft BI Stack
  • Experience working in various formats - XML, JSON, AVRO, PARQUET etc.
  • Strong MS SQL Server product stack Situational Awareness, with the ability to identify risks and issues and their mitigation as they arise

Skills

  • MS SQL Server 2008
  • Pyspark
  • Yarn
  • Shell Scripting
  • JSON
  • Azure or AWS
  • MS BI Stack
  • Oozie, HIVE, Impala, ELK etc.
  • XML
  • ETL and Data Warehousing

Benefits

In return for these specialist skills, my client is offering an excellent benefits package. Not only will you be receiving exceptional benefits but you will also be part of an expanding team using cutting edge technology where you can bring your skills to expand and grow.

The benefits include;

  • Bonus Scheme
  • Pension Scheme
  • Holiday's plus Bank Holidays
  • Discount on all products in the business

In return for these specialist skills, my client is offering an excellent benefits package. Not only will you be receiving these exceptional benefits but you will also be part of an expanding team using cutting edge technology where you can bring your skills to expand on and grow.

For more information please apply directly or call Joanna Barrow on 0131 558 4800.

Similar jobs
View more similar jobs