Software Developer/Data Engineer
On-siteCape Town, Western Cape, South Africa
Job Summary
Implement scalable data pipelines and architectures using PySpark, Python, and SQL while building distributed compute tiers on AWS Lambda and Glue. Automate ingestion by constructing pipelines and collaborate with the team to deliver high-quality solutions that meet business requirements. Serve as a technical resource to mentor junior engineers, ensure code follows best practices, and assist the DEVOPS Engineer in automation and CI/CD practices. Evaluate and recommend new technologies to improve system performance and reliability. This 12-month contract requires a BSc in Computer Science, AWS Professional Certification, and 4-8 years of experience in data-driven ecosystems.
Required Qualifications
- BSc Computer Science / BEng
- AWS Professional Certification
- 4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems
- Ability to automate ingestion by building ingestion pipelines using AWS Lambda or Glue
- Proficiency in coding languages: PySpark, Python, SQL
- Hands-on experience with AWS services, including S3, Athena, Lambda Functions, GLUE, EC2
- AWS experience and AWS certification required
- Experience in data modeling and data architecture design
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.