Role: Big Data Architect
Location: London, UK
Job Type: Contract initially 6 months
Rate: 585 Per day inside ir35(maximum)
Job Description:
- Architecture and its concepts Technical Skills; Kafka and Nifi (Working knowledge)
- Scala(Must have hands-on) Python Spark & Spark Scala Hands-on Development(ETL)(Must be good) SQL/Spark SQL(Must be good)
- Java/JVM Spark(Must be good) Distributed processing, Performance tuning(Must be good) Hadoop Concepts(Must be good)
- SQOOP HIVE(Must be good) DevOps(Working knowledge)
- Production support File Formats(XML, JSON, Parquet and CSV ) Working knowledge of different file processing Open source/Scheduling Tools Airflow or any other Knowledge of one tool Oozy Quality Management Cloud AZURE/AWS/GCP(Preferred AWS)
- Must have experience with one of the cloud platforms. Good to have knowledge about encryption Communication Skills Troubleshooting activities (must be good)