Accessibility Links

Data Architect - AWS - Big Data - Finance - Banking

  • Salary: Excellent
  • Job type: Contract
  • Location: london, London
  • Sector: IT
  • Date posted: 15/03/2018
  • Job reference: J379575A

Big Data Architect, Data Architect, AWS Solution Architect, Amazon Kinesis, EMR Clusters, AWS Lambda, Redshift, Big Data Files.

My leading financial services client is looking for a Data Architect/ AWS Solution Architect you must have a proven background designing data pipelines leveraging AWS technologies (e.g. AWS data pipelines, Amazon Kinesis, EMR Clusters, AWS Lambda, Redshift) . Strong working knowledge of architecture, performance and best practices in either Apache Hive or Apache Spark, ideally on EMR Clusters. Experience in architecting and designing big data solutions with NoSQL and MPP products. Together with experience with data governance, specifically developing data quality processes. Ideally you will have a good understanding of financial services, banking products and the underlying technology solutions and architectures or/and relevant experience of Digital/Ecommerce platforms


  • Experience developing Large scale data architecture for a Hadoop environment with at least Hive, Pig, Oozie and Spark
  • Experience designing scalable data integration jobs, workflows and orchestration in a multi-TB traditional relational data warehouse and a large scale big data environment
  • Experience in designing security, encryption, access control and data masking patterns for large scale batch data ingestion and processing pipelines on AWS
  • Experience designing stream ingesting and processing data pipelines leveraging open source technologies like Kafka, Storm, Flink, Flume
  • Strong experience working with RDMS databases (e.g. PostgreSQL or SQL Server), managing connection-pools, performance tuning and optimizations
  • Exposure to the Hashicorp product stack (Terraform, Consul, Packer, Vault), Jenkins, Config Management and

If this sounds of interest please send me your CV ASAP for review

Similar jobs
View more similar jobs