Data Engineer
On-siteKuala Lumpur, Kuala Lumpur, Malaysia
Job Summary
Design, build, and maintain scalable data pipelines and ETL/ELT workflows using Snowflake, Databricks, and Azure cloud services. Develop and optimize data lake and warehouse solutions while implementing ingestion, transformation, and processing frameworks for structured and unstructured datasets. Work closely with cross-functional teams to support data consumption needs, build reusable pipeline components, and enforce data quality validation, reconciliation, and monitoring controls. Optimize performance for storage, compute, and query execution while ensuring adherence to data governance, security standards, and compliance requirements. Contribute to solution architecture discussions and technical design decisions.
Required Qualifications
- 7–8+ years of hands-on experience as a Data Engineer
- Strong experience in Snowflake and/or Databricks
- Hands-on experience on Azure Cloud
- Expertise in SQL and performance tuning for large datasets
- Experience developing ETL/ELT pipelines using modern data frameworks
- Proficiency with scripting languages such as Python or Scala
- Experience with data modeling techniques (star schema, normalized models, dimensional modeling)
- Experience with CI/CD for data pipelines and version control (Git)
- Exposure to data governance, metadata management, and data quality frameworks
Desired Qualifications
- both preferred
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.