Senior QA Data Engineer - Quality Assurance

  • Location

    London, England

  • Sector:


  • Job type:


  • Salary:

    £70000 - £83000 per annum + Excellent Benifits

  • Contact:

    Matthew Costello

  • Contact email:

  • Job ref:


  • Published:

    4 months ago

  • Expiry date:


Senior QA, Quality Assurance, Javascript, Java, C#, Python, Hortonworks, Cloudera

My leading client is looking for a Senior Data QA Engineer you will be responsible for the testing and validation of data pipelines, and showcase to subject matter experts to learn whether it meets their business outcomes. You will be expert at working in cloud environments, such as on Hortonworks and Cloudera based Hadoop clusters. Assurance of data security and privacy in the platform will be relevant to the data pipelines you validate. You will draw on your experiences to engage in discussion with the technical design lead and other technical staff, recommending options for continuous improvements to testing methods.

Understanding of Quality Assurance data practices

    • Hands-on experience writing unit tests and mocking the data
    • Hands on experience to analyse regression reports, automated builds and KPI's
    • Experience of Test-Driven Development applying pair programming and refactoring principles
    • Strong experience of writing BDD acceptance criteria or scenarios
    • Participated in full development data lifecycle

Knowledge of software development experiences

    • 3+ years experience in one of JS/Java/C# programming languages and must have desire to develop strong experience in SQL/HQL for complicated queries
    • Automated test framework development from scratch using Python
    • Experience or at least keen interest in using big data technologies like PySpark/Yarn and Hive

Hands on experience with Linux and Microsoft Azure cloud environment or equivalent

    • Experience in using considerable data sizes (TB/PB)
    • Exposure to continuous build and deployment process, with hands on experience in using build systems such as Oozie/Jenkins
    • Familiar with defect management systems either using JIRA or similar

If this role sounds of interest please can you give me a call ASAP