Azure Data Integration Engineer (DP600/700)
Remote
RemoteFull TimeSmall
Full TimeSmall
Job Summary
Build and manage Azure Synapse pipelines and PySpark data transformations, ensuring accurate reporting and smooth data flow across Delta Lake environments. Troubleshoot ETL failures, pipeline issues, and data inconsistencies in Synapse Analytics while monitoring Jira tickets and resolving them using SQL and Synapse tools. Collaborate with the Azure DevOps team on CI/CD processes for IaC and Workspace artifacts, and develop custom customer solutions defined by the Data Architect. Document ticket resolutions and testing protocols, and provide specifications for customer enhancements.
Required Qualifications
- 5+ years of Dynamics 365 ecosystem experience
- strong PySpark development background
- Certifications in Azure Data Fabric: DP-600 / DP-700
- Extensive experience with SQL, including query writing and troubleshooting in Azure SQL, Synapse Analytics, and Delta Lake environments
- Strong understanding and experience in implementing and supporting ETL processes, Data Lakes, and data engineering solutions
- Proficiency in using Azure Synapse Analytics, including workspace management, pipeline creation, and data flow management
- Hands-on experience with PySpark for data processing and automation
- Ability to use VPNs, MFA, RDP, jump boxes/jump hosts, etc., to operate within the customers secure environments
- Some experience with Azure DevOps CI/CD IaC and release pipelines
- Ability to communicate effectively both verbally and in writing, with strong problem-solving and analytical skills
- Understanding of the operation and underlying data structure of D365 Finance and Operations, Business Central, and Customer Engagement
- Experience with Data Engineering in Microsoft Fabric
- Experience with Delta Lake and Azure data engineering concepts (e.g., ADLS, ADF, Synapse, AAD, Databricks)
Desired Qualifications
- strong person-organization fit
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.