Azure Databricks Engineer
On-site · Bengaluru, Karnataka, India or Pune, Maharashtra, India
Job Summary
Design, develop, and optimize data pipelines and analytics solutions using Databricks, PySpark, and SQL. Collaborate with data architects, analysts, and business stakeholders to deliver high-quality data solutions while maintaining data quality, governance, and compliance. Integrate data from diverse sources and handle large-scale datasets; diagnose issues and improve performance of data workflows and queries. Must-have skills include Databricks (Delta Lake, ML capabilities), PySpark, and SQL. Nice-to-have skills cover cloud services on Azure (ADF, Synapse, Purview, Fabric), AWS Glue/Lambda/Step Functions, Airflow, DBT, Fivetran, Informatica, Kafka, Power BI, data governance tools (Collibra, Alation), and GCP BigQuery.
Required Qualifications
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related discipline
- 4+ years of experience in data engineering or a related field
- Strong proficiency in Databricks including Delta Lake and machine learning capabilities
- Advanced expertise in PySpark for distributed data processing
- Excellent SQL skills for data manipulation and analytics
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.