Lead AWS Data Engineer
On-siteJersey City, New Jersey, United States
Job Summary
Design and implement end-to-end data pipelines using PySpark, Snowflake, and AWS cloud services to support complex insurance analytics initiatives. Architect scalable ELT/ETL workflows and drive data migration efforts from legacy environments to cloud-native platforms. Develop complex SQL transformations, data quality validation frameworks, and enforce engineering standards across distributed onshore and offshore teams. Serve as the technical point of contact for business stakeholders, translating requirements into engineering deliverables while mentoring junior engineers. Requires 6–9 years of experience with Snowflake, AWS services, and PySpark. Located in JC, NJ (3–4 days in office) for a C2C role.
Required Qualifications
- Deep experience with Snowflake including data modeling, performance tuning
- Proficiency with AWS services — S3, Glue, Lambda, EMR, Redshift, Step Functions, CloudWatch
- Strong experience building distributed data processing frameworks with Apache Spark / PySpark
- Advanced SQL skills — complex transformations, query optimization, and dimensional modeling
- Expertise in DWH design patterns — Kimball, Inmon, Data Vault, star and snowflake schemas
- Demonstrated experience leading or contributing to cloud migration and legacy modernization programs
- Solid Python programming for data engineering and automation tasks
- 6–9 years of progressive experience in data engineering
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field
Desired Qualifications
- Prior experience in insurance, financial services, or regulated industries preferred
- Familiarity with tools such as dbt, Apache Airflow, AWS Glue, or similar orchestration frameworks
- Experience coordinating distributed teams across time zones (onshore/offshore model)
- Demonstrated ability to engage with non-technical stakeholders and translate business requirements
- Exposure to Agile/Scrum delivery methodology
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.