Databricks + PySpark - Technical Lead-Data Engg
On-siteMumbai, Maharashtra, India
Mumbai, Maharashtra, IndiaOn-siteFull TimeSenior LevelEnterprise
Full TimeSenior LevelEnterprise
Job Summary
Design, develop, and deploy scalable data pipelines using Azure Databricks, PySpark, SQL, and Data Factory to integrate new data sources and manage increasing volume. Create technical specifications and application interfaces while building modern data warehouse solutions for structured and unstructured data processing. Collaborate with BI, analytics, and business teams to support batch processing and integration solutions. Requires minimum 2-3 years of project experience in Azure Databricks, 2-3 years in ADF, and 2+ years in PySpark. Located in Mumbai, Pune, Noida, or Bangalore.
Required Qualifications
- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory)
- Experience in creating Technical Specification Design, Application Interface Design
- Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Databricks) and PySpark
- Develop batch processing and integration solutions and process Structured and Non-Structured Data
- Demonstrated in-depth skills with Databricks and PySpark, and SQL
- Minimum 2 to 3 year of Project experience in Azure Databricks
- Minimum 2-3 years of experience in ADF
- Minimum 2+ years of experience in PySpark
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.