Lead Data engineer
On-siteMelbourne, Victoria, Australia
Melbourne, Victoria, AustraliaOn-siteFull TimeMid LevelEnterprise
Full TimeMid LevelEnterprise
Job Summary
The Lead Data Engineer will partner with clients to design and implement customized data solutions to address complex business challenges. Required skills include expertise in Azure Data Bricks, Azure Data Factory, Azure Data Lake, Synapse, and Azure SQL. The role involves turning business use cases into technical solutions, conducting data profiling, and building data pipelines and system integrations. Experience in Azure IoT, Databricks/Spark, Azure Cosmos DB, and Azure Stream Analytics is essential. Familiarity with Python, data preparation for Data Science, and collaboration with remote teams is desirable.
Required Qualifications
- Experience as an Azure Data Bricks
- Knowledge of Azure Data Factory, Azure Data Lake, Synapse, and Azure SQL
- Knowledge/experience in Azure IoT, Databricks / Spark, Azure Cosmos DB, Azure Stream Analytics
- Experience preparing data for Data Science / Machine Learning / BI solutions
- Strong team collaboration
- Working experience with Visual Studio, PowerShell Scripting, and ARM templates
- Experience with DevOps/Git/TFS/VSTS
Desired Qualifications
- Knowledge of Python