Data Engineer
HybridMakati City, Metro Manila, Philippines
Job Summary
Design and develop data models using SQL, Spark, Python, and Airflow while troubleshooting performance issues and managing ETL pipelines on AWS. Lead end-to-end data flow analysis across multiple systems to uncover root causes, identify risks, and recommend business solutions. Monitor data quality, control totals, and metadata integrity to ensure load assurance and governance compliance. Drive resolution of technical issues within an Agile and DevOps environment. Requires 3–4 years of hands-on SQL experience and familiarity with cloud services including EC2, S3, IAM, EKS, and RDS.
Required Qualifications
- Previously worked closely with data architect or data modellers
- can independently work on data analysis
- data modelling
- Proficient in manipulating data
- drawing insights from large data sets using SQL
- Highly proficient in data preparation
- integration
- design, develop and modify data models
- troubleshoot performance issues
- Good in doing downstream analysis
- understanding end to end data flow when multiple systems are involved
- Experienced with working on Agile delivery
- at least 3 to 4 years of hands-on experience in SQL
- Advanced data engineering skills
- strong experience using Spark
- SQL
- Python
- Airflow
- Strong knowledge of big data querying tools such as Presto or Trino
- Experience in data architecture principles
- data access patterns
- data modelling
- Experience with data quality measurement
- monitoring
- metadata
- control totals
- check sums for load assurance
- Comfortable taking ownership of issues
- driving resolution
- Familiar with cloud computing concepts (AWS)
- EC2
- S3
- IAM
- EKS
- RDS
- Linux
- Good understanding of Data Warehousing/ETL concepts
- Experience with CI/CD tools
- Experienced with DevOps approaches
Desired Qualifications
- Familiarity with data governance
- data quality and control frameworks would certainly be useful in this role
- Able to creatively use data and insights to uncover new opportunities
- identify root causes
- underlying risks to recommend solutions to the business
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.