Principal Data Engineer
On-siteSydney, New South Wales, Australia
Job Summary
Architect and own delivery of shared data products across Finance, People, Procurement, and Compliance, building the unified semantic layer that powers reporting, self-service analytics, and Databricks Genie. Design scalable data pipelines and models using Databricks, dbt, SQL, and PySpark while implementing end-to-end governance including Unity Catalog access controls, column-level security, and data lineage. Translate complex stakeholder requirements into production-grade solutions, set engineering standards through code quality and PR reviews, and drive DataHub adoption by defining metadata standards and ownership models. Work across a broad range of domains to build the governed data foundation that supports AI agents and conversational analytics.
Required Qualifications
- 12+ years of experience designing and building production data solutions
- Track record of leading complex technical initiatives end-to-end
- Expert-level SQL and data transformation skills
- Strong hands-on experience in dbt, PySpark, or both
- Deep experience with Databricks, Lakehouse architectures, or comparable modern data technologies
- Experience implementing governance at scale, including access control, PII handling, column-level security, data lineage, and data quality management in production environments
- Experience building trusted business-facing data products within Finance, People/HR, Procurement, Operations, or similar domains
Desired Qualifications
- Experience with Unity Catalog governance
- Experience with DataHub
- Experience with Databricks Genie
- Experience with Delta table design
- Experience with compute trade-offs
- Experience with downstream BI or AI workloads
- Experience writing tests without friction
- Clear opinions on where each tool's limits are
- Understanding of business logic well enough to challenge unclear or incorrect requirements
- Experience working across a broad range of domains, from People and Finance to Procurement and Compliance
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.