Sr Data Engineer II
On-site · Bengaluru, Karnataka, India
Job Summary
Sr Data Engineer II at Disney Entertainment and ESPN Product & Technology responsible for designing and building scalable data pipelines and data products in Python/Scala/Spark, implementing Lakehouse architectures, and collaborating with Data Product Managers and Engineers to deliver data solutions. The role emphasizes developing ETL pipelines in Big Data environments (cloud, on-prem, hybrid) using AWS stack (S3, EMR, EC2), Snowflake/Redshift/BigQuery, Airflow, Databricks, Delta Lake, Spark, and SQL. It requires contributing to architecture, maintaining uptime SLAs, documenting changes, advocating agile/scrum practices, and driving data quality, governance, and cost optimization. Desired candidate will have hands-on experience with distributed systems, data modeling and warehousing techniques, and strong communication to partner across teams within a large media tech organization. Education includes a Bachelor's degree in computer science or related field.
Required Qualifications
- At least 5 years of data engineering experience developing large data pipelines
- Strong hands-on experience with Cloud technologies like AWS (S3, EMR, EC2) and building data pipelines
- Strong SQL skills and ability to create queries to extract data and build performant datasets
- Hands-on experience with distributed systems such as Spark, Hadoop (HDFS, Hive, Presto, PySpark) to query and process data
- Strong fundamental Scala and Python programming skills
- Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Big Query)
- Solid experience with data integration toolsets (Airflow) and writing and maintaining Data Pipelines with Databricks
- Experience in Data Modeling techniques and Data Warehousing standard methodologies and practices
- Familiar with Scrum and Agile methodologies
- Demonstrated excellent interpersonal skills, communication skills including ability to partner with others and build consensus in a cross-functional team toward a desired outcome
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.