Data Engineer
On-sitePort Melbourne, Victoria, Australia
Port Melbourne, Victoria, AustraliaOn-siteFull TimeSmall
Full TimeSmall
Job Summary
Design and maintain ETL pipelines for large volumes of imagery and video data, transforming raw sensor feeds into clean, structured datasets for the Machine Learning team. Conduct exploratory data analysis to assess quality, coverage, and gaps, then build fast prototype visualizations to surface issues and communicate findings. Write optimized SQL to query and manage data at scale, ensuring all outputs are trustworthy, well-labelled, and ready for model training. Collaborate closely with ML engineers to define training-ready requirements and maintain comprehensive documentation of pipelines and data quality processes.
Required Qualifications
- Tertiary qualification in computer science, engineering, data science, or a related discipline.
- 3+ years of experience in data engineering, data analysis, or a related field, ideally working with imagery or video data.
- Demonstrated experience building ETL pipelines, ideally with image or video data.
- Strong SQL skills, with experience managing and querying large datasets.
- Comfortable prototyping quickly in Python, using libraries such as Pandas, Matplotlib, or similar for exploratory analysis and visualisation.
- Experience working with unstructured or semi-structured data (images, video, sensor data).
- Understanding of what makes a dataset ML-ready — labelling, balance, quality checks.
- Eligible for security clearance.
Desired Qualifications
- Exposure to computer vision or ML data pipelines specifically.
- Experience with cloud data storage/processing (e.g. S3, BigQuery, or similar).
- Familiarity with OpenCV or similar image-processing libraries.
- Experience with data versioning or annotation tooling.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.