Azure Data Engineer (ID: 3870)
On-siteAmsterdam, North Holland, The Netherlands
Amsterdam, North Holland, The NetherlandsOn-siteFull TimeSmall
Full TimeSmall
Job Summary
Design, develop, and maintain scalable data pipelines using Azure Data Factory and Azure Databricks. Build and optimize large-scale ETL/ELT workflows with Python and PySpark to ensure high performance and reliability. Implement CI/CD pipelines in Azure DevOps to automate deployment and testing while collaborating with stakeholders to translate requirements into robust solutions. Monitor and troubleshoot data solutions to guarantee data quality, security, and compliance with industry best practices. Document technical solutions and contribute to continuous improvement of cloud data engineering practices.
Required Qualifications
- 5+ years of experience in Data Engineering with a strong focus on Microsoft Azure
- Hands-on experience with Azure Data Factory (ADF) for orchestrating data movement and transformation workflows
- Strong expertise in Azure Databricks for developing scalable big data processing solutions
- Proficiency in Python and PySpark for distributed data processing and ETL development
- Experience implementing CI/CD pipelines using Azure DevOps
- Strong knowledge of SQL for querying, transforming, and managing large datasets
- Experience working with cloud-based data platforms and modern data engineering best practices
- Good understanding of data security, performance tuning, and optimization techniques
- Strong analytical, problem-solving, and debugging skills
- Excellent communication, collaboration, and technical documentation skills
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.