AI Data Engineer
On-siteSingapore, Singapore
Job Summary
Design, build, and maintain scalable data pipelines for AI, analytics, and automation solutions using Microsoft Fabric, Databricks, and medallion architecture. Ingest, transform, and deliver data from enterprise systems, files, and databases while developing reliable ETL/ELT processes and monitoring performance to resolve data flow issues. Integrate data across cloud platforms and business applications by building connectors, APIs, and data services, ensuring datasets are accurate, governed, and fit for machine learning use cases. Implement monitoring, error handling, and lineage to support data quality and documentation standards. This 3-year fixed term contract in Singapore requires a candidate with 5+ years of experience in SQL, Python, and PySpark to prepare structured data for model evaluation and ongoing AI solution development.
Required Qualifications
- Tertiary institution/ bachelor's degree (IT, Computer Science, Engineering, Data/AI, or equivalent experience)
- 5+ years (Experience designing, building and maintaining data pipelines or data integrations.)
- Strong SQL and Python/PySpark skills for data processing, transformation and automation
- Experience supporting AI/ML, analytics or automation solutions with reliable data inputs
- Experience with ETL/ELT, data modelling, data quality and metadata management
- Experience integrating data from enterprise systems, APIs, files and databases
- Familiarity with security, privacy and data governance requirements
- Experience working in agile or collaborative technical delivery environments
- CI/CD and git-based deployment workflows
- Microsoft Fabric or Databricks with a medallion architecture
- Knowledge of data practices (dimensional models, normalizing data, etc.)
- Knowledge of data platform design (federated versus centralized, etc.)
- Strong troubleshooting skills with focus on root cause resolution
- 0-1 years Formal people management experience is not required
- Exposure to collaborative projects and agile delivery
- Experience contributing to AI, analytics, automation or data platform initiatives through hands-on data engineering, integration and technical delivery
Desired Qualifications
- Microsoft certifications are a plus
- Experience with Copilot 365, Copilot Studio, Github Copilot, Azure data services
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.