IN_Manager_Data Engineer_D&A_Advisory_Mumbai
On-site · Mumbai, Maharashtra, India
Job Summary
Data Engineer (Azure Databricks) responsible for designing, building, and supporting batch and near real-time data pipelines on Azure, delivering analytics-ready datasets for insurance use cases. Develop and optimize Databricks notebooks/jobs using PySpark/Spark, SQL, and Python; implement and maintain lakehouse tables (Delta) with proper partitioning and file layouts; create orchestration with Azure Data Factory and/or Databricks Workflows; implement data quality checks, observability, and incident triage; apply security/governance controls for regulated/PII data and support audits; tune Spark workloads and manage Azure/Databricks costs. Collaborate with architects, analysts, and business stakeholders to provide trusted insights and scalable data solutions. Preferred certifications include Azure Data Engineer Associate and/or Databricks; knowledge of Delta Live Tables/Unity Catalog and insurance data domains is a plus.
Required Qualifications
- Bachelor’s/master’s degree in computer science, Engineering, or related
- 3–6 years of data engineering experience delivering production pipelines on Azure
- Strong Databricks expertise (Spark/PySpark), SQL, and Python
- Hands-on with Azure data services (ADLS Gen2, ADF) and CI/CD using Git-based workflows; familiarity with DevOps practices is a plus
- Good understanding of data modeling and lakehouse patterns (Delta)
- Strong communication and stakeholder management; ability to translate requirements into scalable data solutions (insurance domain preferred)
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.