Azure Data Engineer
On-siteHyderabad, Telangana, India
Job Summary
Design and implement scalable data pipelines using Azure services, including Azure Data Factory, Databricks, and Synapse Analytics. Develop and maintain ETL/ELT workflows for structured and unstructured data while integrating sources via APIs, databases, and streaming platforms. Create and manage data lakes, warehouses, and medallion architectures to support analytics and business intelligence initiatives. Ensure data quality, governance, security, and compliance standards. Monitor and troubleshoot production workflows and optimize SQL queries for performance. Implement CI/CD pipelines and infrastructure automation for data platforms. Collaborate with analysts, DevOps, and stakeholders to deliver robust cloud-based solutions.
Required Qualifications
- Strong experience with Azure Data Factory (ADF)
- Strong experience with Azure Databricks
- Strong experience with Azure Synapse Analytics
- Strong experience with Azure Data Lake Storage (ADLS)
- Strong experience with Azure SQL Database
- Strong experience with Azure Functions
- Strong experience with Azure Event Hub / Service Bus
- Proficiency in SQL
- Proficiency in Python / PySpark
- Experience with ETL/ELT pipeline development
- Experience with Data modeling and warehousing concepts
- Experience with Spark-based distributed processing
- Experience with REST APIs and data integration
- Experience with Git, CI/CD, and DevOps practices
Desired Qualifications
- Scala (optional)
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.