Data Engineer - Advanced Analytics
Remote
Essential Skills:
Computer Science or equivalent education and experience
BPSS (SC desired)
2+ years of data experience with data analysis and preparation, including experience with very large data sets
Data manipulation and extraction using Python, SQL, AWS Redshift
Skills required: Python, SQL, AWS Glue, AWS Redshift, AWS Lambda, AWS Step Functions, AWS App Config
Understanding of data migration, migration of existing data platforms to new environment
Strong understanding of Python (other languages an advantage), AWS technologies (as above)
Strong understanding Data Governance tooling
Strong experience in SQL, database development & data modeling
Solid business and collaboration skills, and responsive to service needs and operational demands
Day to day activities:
Act as a liaison between consumer teams and source system/data owners
Assess and understand data feeds and create design for target platform using data onboarding proforma
Collects, blends, and transforms data using ELT tools, database management system tools, and code development (e.g. AWS Glue, AWS Step Functions, AWS Event Bridge, AWS Redshift, AWS S3, Python, SQL)
Assess, design and implement data quality correction and profiling algorithms
Interacts with end user teams, and capable of understanding how data needs to be structured for consumption. Implements data models and structures data in ready-for consumption using PowerBI
Test data pipelines from functional and performance perspective.
