Senior Data Engineer
HybridKuala Lumpur, Kuala Lumpur, Malaysia
Job Summary
Design, build, and operate scalable, secure, and efficient data products, pipelines, and platforms using native AWS and Azure services including serverless architectures. Own the end-to-end lifecycle of data solutions, ensuring operational accountability, supportability, and continuous improvement through DataOps best practices such as CI/CD, Infrastructure as Code, and automated testing. Collaborate with business stakeholders, engineers, and data scientists to deliver high-quality data solutions while maintaining metadata, lineage, documentation, and governance standards. Lead incident resolution, root cause analysis, and reliability improvements to reduce recurring issues and improve service outcomes. Provide technical leadership through architecture guidance, mentoring, and code reviews to foster an environment where software and platform engineers thrive.
Required Qualifications
- 8+ years of experience in Data Engineering, Software Engineering, or related disciplines
- 5+ years of hands-on Python development experience
- 3+ years of experience with PySpark and large-scale distributed data processing
- Shown experience delivering and operating enterprise-scale data platforms and pipelines
- Experience working in DataOps, DevOps, SRE, or production support environments
- Strong expertise in SQL, database design, and data modelling
- Experience designing end-to-end data architectures including ingestion, transformation, storage, governance, and consumption layers
- Strong AWS experience, including services such as S3, Glue, Lambda, Athena, Redshift, and EventBridge
- Hands-on experience with Databricks and modern Lakehouse architectures
- Experience with Git, CI/CD, Infrastructure as Code, and deployment automation
- Strong understanding of observability, monitoring, alerting, and platform reliability
- Experience implementing data quality controls, lineage, metadata, and governance practices
- Experience with incident management, root cause analysis, and continuous service improvement
- Knowledge of security, privacy, compliance, and operational risk management
- Excellent stakeholder management and communication skills
- Shown ability to influence technical decisions, mentor engineers, and drive engineering excellence
- Demonstrated ownership mindset with a focus on reliability, quality, and business outcomes
- Must be able to lift 50 lbs
Desired Qualifications
- Bachelor's degree
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.