Agile Analytics logo
Agile AnalyticsPosted 3 months ago

Principal Data Engineer Consultant - Brisbane & Sydney

HybridBrisbane, Queensland, Australia

Full TimeSenior Level

Job Summary

Lead solution architecture for modern data platforms, designing scalable pipelines, lakehouses, and integration solutions using Microsoft Fabric and the Azure Data ecosystem. Act as a trusted advisor to clients, conducting workshops, assessments, and proof-of-concept projects to shape data strategy and modernisation roadmaps. Mentor project teams, drive innovation with AI tools, and collaborate with delivery managers to ensure quality and timelines are met across concurrent engagements. Translate complex technical concepts into clear business outcomes for executive stakeholders while expanding existing accounts.

Required Qualifications

  • 8+ years of experience in data engineering
  • significant time delivering data solutions on Microsoft Azure
  • Proven track record delivering large-scale, enterprise-grade data solutions in a consulting or client-facing environment
  • Experience leading project teams
  • owning architecture decisions
  • acting as the senior technical voice in client engagements
  • strong hands-on experience designing and delivering Fabric-based solutions
  • experience with Lakehouse
  • experience with Warehouse
  • experience with Data Factory
  • experience with Real-Time Intelligence
  • experience with OneLake
  • solid experience across Azure Data Factory
  • solid experience across Azure Data Lake
  • solid experience across Azure Synapse
  • solid experience across Azure SQL
  • Strong proficiency in data modelling
  • ETL/ELT design
  • building scalable, well-governed data pipelines
  • Proficiency in Python
  • Proficiency in PySpark
  • Proficiency in SQL
  • Hands-on experience with CI/CD for data platforms
  • Working knowledge of cloud security
  • Working knowledge of compliance
  • Working knowledge of data governance frameworks
  • Practical experience using AI tools
  • a point of view on how to apply them well in client delivery
  • Client relationship management
  • Communication & presentation
  • Leadership
  • Technical project leadership
  • Architecture & advisory mindset
  • Problem-solving and pragmatism
  • Must be in Australia
  • have full work rights

Desired Qualifications

  • Databricks
  • hands-on experience with Databricks on Azure
  • experience with Unity Catalog
  • experience with Delta
  • experience with workflows
  • Microsoft Purview
  • experience implementing data governance
  • experience with cataloguing
  • experience with lineage
  • Familiarity with Power BI
  • the broader Microsoft analytics ecosystem
  • Exposure to data mesh
  • data product thinking
  • federated governance models
  • Microsoft Certified: Fabric Data Engineer Associate
  • Fabric Analytics Engineer Associate
  • Microsoft Certified: Azure Data Engineer Associate
  • Microsoft Certified: Azure Solutions Architect Expert
  • Databricks certifications
  • Data Engineer Associate
  • Data Engineer Professional
  • Other relevant Azure / Data & AI certifications

Hiring someone like this?

Get your role in front of qualified candidates on Sorce.

Get started

Apply to this job in one click with Sorce

Apply on Sorce