Manager, Data Engineering Operations
Remote · United States
Job Summary
Manager, Data Operations leading a Databricks-based data platform team to ensure reliability, performance, and scalability. Own operational health, set technical direction, mentor engineers, and partner with IT, Security, and Engineering to govern data pipelines and infrastructure. Drive incident management, root-cause analysis, runbooks, on-call practices, and KPI reporting (uptime, pipeline reliability, cost). Build and maintain Databricks Workflows, orchestration, and governance while advocating coding standards, testing, observability, and documentation. Communicate operational status and roadmap to diverse audiences and collaborate with downstream consumers to ensure platform meets needs. This role requires strong technical fluency with SQL, Python, Spark, Delta, Azure data services, and data governance tools, and demonstrable leadership in scaling data platforms within a healthcare-focused or enterprise context.
Required Qualifications
- 8+ years of hands-on data engineering experience
- at least 2 years in a leadership or management role
- Strong hands-on background with SQL development and relational/non-relational databases (data modeling, schema design, query optimization)
- Professional experience developing scalable solutions in Python or a similar object-oriented language
- Proficiency in Databricks, Spark, and Delta tables; experience operating large-scale distributed data processing in production
- Experience operating and monitoring data pipelines at scale, including incident response and on-call leadership
- Solid understanding of Lakehouse and Medallion architectures
- Experience with Azure data services (ADLS Gen2, Azure Data Factory, Event Hubs, or equivalent)
- Familiarity with Unity Catalog for data governance, access control, and data lineage
- Experience designing and maintaining data integration/ETL pipelines using Azure Data Factory or equivalent
- Excellent communication and organizational skills
- Ability to drive alignment across cross-functional stakeholders
- Experience hiring, developing, and retaining engineering talent
- Strong operational ownership mindset with focus on reliability, scalability, and continuous improvement
- Leadership ability to set technical direction while balancing business priorities
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.