Intermediate Data Engineer
On-siteJohannesburg, Gauteng, South Africa
Job Summary
Identify shortcomings in existing processes and deliver change management plans with project manager guidance. Build analytics tools utilizing data pipelines to provide actionable insights on customer acquisition and operational efficiency. Monitor metrics, analyze data, and lead partnerships with Data and Analytics teams to implement system improvements and automate manual tasks. Develop ETL processes converting data into consumption formats while executing testing and validation aligned with data governance and compliance requirements. Collaborate with analysts and scientists to define high-quality business data requirements and establish governance standards. Act as a subject matter expert providing input on all data engineering decisions and infrastructure redesigns for scalability.
Required Qualifications
- Post Graduate Degree: Information Technology
- Post Graduate Degree: Information Studies
- Masters Degree: Information Technology
- Masters Degree: Information Studies
- Minimum 3 years experience
- IT Architecture
- Data Integrity
- IT Applications
- Data Analysis
- Knowledge Classification
- C++
- Amazon Web Services
- Amazon S3
- Databricks
- Database systems (SQL and NoSQL)
- Data warehousing solutions
- ETL tools
- ETL (Extract, Transfer, Load)
- Data APIs
- Python, Java, R and Scala programming languages
- Understanding the basics of distributed systems
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.