Senior Data Engineer (Microsoft Fabric / Azure) - Hybrid, Sydney preferred
HybridNorth Sydney, New South Wales, Australia
Job Summary
Design and build modern data platforms on Microsoft Fabric, including Lakehouse, OneLake, Data Factory pipelines, Notebooks, and semantic models. Lead Azure data platform initiatives using Data Factory, SQL, Synapse, and Storage, while optimizing Spark-based transformations and performance. Implement lakehouse and medallion patterns, dimensional modelling, and batch/incremental ingestion strategies alongside CI/CD pipelines via Azure DevOps or GitHub. Collaborate directly with clients across government, energy, and financial sectors to run workshops, deliver end-to-end analytics solutions, and mentor team members. Optimize Power BI datasets and reports built on these platforms. Requires full Australian work rights and a hybrid schedule based in Sydney or other Australian states.
Required Qualifications
- Microsoft Fabric — hands-on delivery experience across Lakehouse, OneLake, Data Factory / pipelines, Notebooks, Warehouse, and semantic models
- Azure data platform — Azure Data Factory, Azure SQL, Synapse Analytics, Azure Storage
- Strong Python and SQL, including Spark-based transformation and performance tuning
- Modern data architecture — lakehouse and medallion patterns, dimensional modelling, batch and incremental ingestion, data quality
- CI/CD and DevOps practices — source control and deployment pipelines using Azure DevOps and/or GitHub (Git branching strategies, automated deployment of data assets, environment promotion)
- Power BI — building and optimising datasets and reports on top of the platforms you deliver
- Consulting delivery experience — comfortable working directly with clients, running workshops, and balancing multiple concurrent projects and priorities
- Strong teamwork and communication — you work collaboratively in project teams, share knowledge, mentor others, and communicate confidently with both technical and business stakeholders
- Experience supporting enterprise data migration and transformation programs
- Full, unrestricted Australian work rights and based in Australia
- Sydney is our preferred location, but we will consider strong candidates based in other Australian states
Desired Qualifications
- Databricks — Lakehouse architecture, Delta Lake, Spark pipeline design and optimisation, Unity Catalog
- Microsoft Purview — data governance, Data Hub / Unified Catalog, data quality, lineage, classification, sensitivity labelling, and compliance
- Real-time / streaming data processing
- Experience delivering into Australian government or other regulated environments
- Microsoft and/or Databricks certifications (e.g. DP-600, DP-700)
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.