Azure Data Engineer - Greece
On-siteThessaloníki, Central Macedonia, Greece
Job Summary
Azure Databricks Data Engineer to design, develop, and maintain scalable data solutions on Microsoft Azure. Build reliable batch and streaming data pipelines using Azure Databricks, PySpark, and Delta Lake to support analytics, reporting, and AI initiatives. Responsibilities include designing, developing, testing, and optimizing pipelines; building scalable ETL/ELT processes; implementing data ingestion from APIs, databases, flat files, and cloud storage; configuring Databricks clusters, jobs, workflows, and notebooks; integrating with ADLS Gen2, Synapse Analytics, and other Azure services; implementing CI/CD for data deployments; enforcing data quality, lineage, and governance with Unity Catalog; monitoring production workloads and participating in incident response; collaborating with Data Architects, Data Scientists, BI Developers, and Business Analysts; maintaining documentation and runbooks.
Required Qualifications
- Over 3.5 years of professional experience as a Data Engineer or in a closely related role working on cloud-based data platforms.
- Over 3 years of hands-on experience with Microsoft Azure services, including practical experience with Azure Databricks.
- Proven hands-on experience developing data processing jobs with Apache Spark / PySpark and applying Spark performance tuning techniques.
- Strong proficiency in Python and SQL for data transformation, validation, and analytics queries.
- Experience with Delta Lake and designing ETL/ELT patterns for reliable, repeatable pipelines.
- Experience integrating and operating Azure Data Factory and ADLS Gen2 within data pipelines.
- Familiarity with Databricks workspace concepts, cluster configuration, job orchestration, and day-to-day control-plane/compute-plane operations.
- Experience implementing data governance and access controls; specific experience with Unity Catalog for governance and fine-grained access control.
- Practical experience with CI/CD for data pipelines and basic infrastructure-as-code concepts (e.g., Git, Azure DevOps, GitHub Actions, Terraform, ARM/Bicep).
- Solid understanding of data modeling and data warehousing concepts and practices.
- Strong analytical, communication, and collaboration skills; ability to work with technical and non-technical stakeholders.
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent practical experience.
- Diverse career growth opportunities
- Extensive portfolio of technical trainings
- Access to certification programs
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.