Data Engineer 12 month FTC
HybridLondon, England, United Kingdom
Job Summary
Develop enterprise-scale data pipelines, support ETL processes across the Medallion Architecture, and ensure data quality, governance, and reporting capabilities. Build modern, cloud-based data solutions using Microsoft Fabric and Azure Data Platform technologies, including Data Factory, Synapse, Lakehouse, and Power BI integration. Contribute to collaborative code reviews, design sessions, and continuous learning opportunities while applying clean code principles and Agile/Scrum methodologies. Work with Spark notebooks and SQL skills to develop scalable data transformations. Hybrid working involves two days in the office and three days at home weekly, with occasional travel possible.
Required Qualifications
- Experienced in a Data Engineering, Data Analytics, or Software Development role
- Good understanding of ETL/ELT concepts and data integration principles
- Very strong PySpark for developing scalable data pipelines and data transformations
- SQL skills (T-SQL and/or Spark SQL)
- Working knowledge of Python
- Hands-on experience with Microsoft Fabric and/or Azure Data Platform technologies
- Experience with Data Factory
- Experience with Synapse
- Experience with Lakehouse
- Experience with Data Pipelines
- Experience with Dataflows Gen2
- Experience with Notebooks
- Experience with Power BI integration
- Understanding of modern data engineering practices
- Understanding of Medallion Architecture (Bronze/Silver/Gold)
- Understanding of CI/CD
- Understanding of Azure DevOps
- Understanding of Agile/Scrum methodologies
- Understanding of testing
- Understanding of clean code principles
- Knowledge of enterprise data warehousing
- Knowledge of semantic models
- Knowledge of data quality
- Knowledge of security
- Knowledge of governance
- Willingness to learn and apply emerging Microsoft Fabric capabilities such as Real-Time Intelligence
- 2 days in the office location listed on this advert
- 3 days working at home each week
Desired Qualifications
- Passionate about data
- Eager to learn
- Excited to work with Microsoft's Azure Data Platform and Microsoft Fabric
- Developing enterprise-scale data pipelines
- Supporting Data Lakehouse and Data Warehouse solutions
- Working with modern data architectures under the guidance of experienced engineers and architects
- Develop, testing, and maintenance of reliable data pipelines
- Support ETL processes across the Medallion Architecture
- Help ensure data quality, governance, and reporting capabilities
- Participate in collaborative code reviews
- Participate in design sessions
- Participate in continuous learning opportunities
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.