Data Engineer
$93,600–$114,400 year
Remote · New York City, New York, United States
Job Summary
Data Engineer responsible for architecting and scaling modern data platforms on AWS, designing and building robust Spark-based ETL/ELT pipelines for batch and real-time use cases, and owning end-to-end data lifecycle management from ingestion to serving. Focus on data quality, governance, observability, and reliability, while driving platform optimization and cost efficiency. Establish engineering best practices (CI/CD, IaC, code reviews, documentation) and collaborate with cross-functional stakeholders to translate data needs into production-grade solutions.
Required Qualifications
- Bachelor’s degree in Computer field or related STEM majors
- 5+ years of industry experience
- Experience with Spark, Scala, Python
- CI/CD
- Experience with data models
- Experience collaborating with stakeholders across business functions
- Experience handling large-scale data
- Strong analytical and problem-solving skills
- Team's Tech Stack includes Spark, Scala, Python, DBT, Airflow, Kafka, AWS EMR, Hive, Redshift, Docker, Lambda, SNS, SQS, S3, Looker, DynamoDB, GitHub Actions, Terraform
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.