Sr Data Engineer
$141,900–$208,400 year
On-site · San Francisco, California, United States or Seattle, Washington, United States
Job Summary
Senior Data Engineer to build and maintain Identity Householding Data products for Disney’s ad tech stack. Responsibilities include building and maintaining scalable, fault-tolerant data processing pipelines (real-time and batch) using distributed systems (Databricks, Spark, Presto, Hive), enhancing data models, increasing unit test coverage, and collaborating with squads, Product Managers, Designers, QA, Operations, and other stakeholders. The role involves on-call participation, code reviews, and promoting Agile methodologies (Scrum, Kanban, Scrumban) to deliver extensible, reusable data solutions. Required: a Bachelor's degree and 5+ years of big data engineering experience; strong Python, Scala/Spark, and SQL skills; experience with cloud databases (Snowflake, Redshift, BigQuery) and data warehousing; familiarity with data integration/orchestration (Airflow); AWS S3 and CI/CD. The role is based in multiple US locations (Santa Monica, Seattle, San Francisco) with full-time employment; compensation ranges vary by location. The job posting also notes a base pay range and potential bonus/long-term incentive units as part of the compensation package.
Required Qualifications
- Bachelor's degree in Computer science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience
- 5+ years of related big data engineering experience modeling and developing large data pipelines
- Hands-on experience with distributed systems such as Databricks compute using tools/libraries such as Spark, Presto, Hive
- Strong Python, Scala/Spark and SQL skills processing big datasets
- Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Big Query, Databricks)
- Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices
- Operational experience in multi-system/services production environment as point-of-contact / SME
- Problem solving skills with strong attention to detail and excellent analytical and communication skills
- Solid experience with data integration and orchestration toolsets (e.g. Airflow), CI/CD
- Solid experience with AWS S3
- Preferred qualifications include Terraform, understanding of householding algorithms and third-party data enrichment tools
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.