Data Platform Engineer
HybridChippendale, New South Wales, Australia
Job Summary
Build and refine the Bedrock Platform using Medallion Data Architecture to structure scalable data models and establish transparent lineage across all pipelines. Automate operational tasks and design automated test suites at each layer to eliminate repetitive break-fix work and ensure end-to-end data quality. Balance ongoing maintenance and bug fixes on the Legacy Platform with dedicated build time for the new architecture while systematically refactoring legacy datasets and logic into Bedrock as customers transition. Reside in Sydney, Australia with full working rights. Requires 2+ years of SQL expertise, experience with dbt or similar tools, and proficiency in Git and SDLC practices.
Required Qualifications
- Residing in Sydney, Australia
- Full Australian working rights
- No temporary / part-time work visas
- No requirement for sponsorship
- 2+ years of deep experience writing complex, performant, and scalable SQL
- Snowflake experience
- Demonstrated ability to interpret messy or unstructured legacy SQL code
- Experience architecting data pipelines
- Experience implementing medallion architecture patterns
- Experience creating data lineage
- Experience designing test suites across each layer
- Comfort working in a fast-paced, lean team
- Knack for balancing legacy maintenance against new feature build
- Ability to pick off low-hanging fruit efficiently
- High proficiency in data manipulation and cleansing techniques
- joins
- transposes
- crosstabs
- regex
- aggregations
- Clear written and verbal communication
- Ability to explain data logic
- Ability to explain lineage
- Ability to explain system trade-offs
- Ability to explain to internal stakeholders
Desired Qualifications
- dbt experience
- Experience using dbt to build scalable data architectures
- Experience building transparent lineage
- Experience building semantic layers
- Commercial experience using software engineering principles
- Git experience
- Branching experience
- Automated testing experience for data workflows
- Strong technical aptitude
- Willingness to learn quickly
- Experience with Alteryx
- Experience with similar visual ETL tools
- Basic familiarity with Tableau
- Experience with similar analytics/dashboarding tools
- Prior experience handling retail, FMCG, or pricing datasets
- Experience with GCP
- Experience with Google Cloud Platform
- Equivalent cloud experience
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.