Senior Data Engineer
On-sitePetaling Jaya, Selangor, Malaysia
Job Summary
Design and implement scalable data pipelines and infrastructure solutions that address business problems, ensuring data quality and timely delivery of datasets to stakeholders. Collaborate with Product, Analytics, ML, and BI teams to understand data requirements, provide feedback on architecture options and trade-offs, and architect data solutions for high-volume streams. Build reliable, maintainable, and performant systems using Python, Scala, or Java, while reviewing code to raise the engineering bar. Manage on-call duty to triage, debug, and resolve complex pipeline issues, and mentor junior engineers. Report to a Senior Engineering Manager in Petaling Jaya, Malaysia, with 4+ years of experience in distributed systems required.
Required Qualifications
- Bachelor's degree in Computer Science, Data Engineering, Information Technology, Statistics, or a related field
- 4+ years of professional data engineering experience in distributed systems environments
- proficiency in at least one data processing language (Python, Scala, Java, or similar)
- experience with computer science fundamentals, including algorithms, data structures, and system design principles
- experience designing and building large-scale, high-throughput data pipelines and ETL systems
- solid knowledge of relational databases (MySQL, PostgreSQL) and NoSQL databases (DynamoDB, MongoDB, Cassandra, or similar)
- experience with cloud data platforms and infrastructure, AWS, including data warehousing solutions and auto-scaling capabilities
- experience with data pipeline orchestration tools (Apache Airflow, Spark, Kafka, or similar)
- strong understanding of data modeling, data quality, and data governance principles
- You will be responsible and responsive during on-call duty.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.