Data Engineer
On-siteAtholl Gardens, Gauteng, South Africa
Atholl Gardens, Gauteng, South AfricaOn-siteFull Time
Full Time
Job Summary
Ensure data availability and quality by creating processes for data flow and access within AWS, Azure, or IBM architectures. Collaborate with architects and analysts to implement data ingestions, maintain data ecosystems, and apply best practices for cloud infrastructure security. Identify improvements to processing reliability, efficiency, and solution performance while preparing comprehensive test strategies for unit, system, and integration testing. Work on-site in Johannesburg or Cape Town within the Data & Analytics department.
Required Qualifications
- Proficient in Python with extensive experience in data processing and analysis
- Strong SQL expertise, adept at writing efficient queries and optimizing database performance
- Previous working experience with the Azure/AWS data stack
- Experienced in software development lifecycle methodologies, with a focus on Agile practices
- Fluent English, both written and spoken
- Candidates applying kindly note this position is an on-site working opportunity from our locations in Johannesburg or Cape Town
Desired Qualifications
- Working closely with Data Architects on AWS, Azure, or IBM architecture designs
- Maintaining and building data ecosystems by working on the implementation of data ingestions
- Ensuring the security of cloud infrastructure and processes by implementing best practices
- Applying modern principles and methodologies to advance business initiatives and capabilities
- Identifying and consulting on ways to improve data processing, reliability, efficiency, and quality, as well as solution cost and performance
- Preparing test cases and strategies for unit testing, system, and integration testing
- Passionate about technology. You anticipate, recognize, and resolve technical problems using a variety of specialized tools for application development and support
- Independent. You are a self-motivated and ambitious individual, capable of managing multiple responsibilities effectively
- Problem-solver. You think creatively and find solutions to complex challenges
- Creative and outside-the-box thinker. You look beyond blog posts and whitepapers, competitions, and even state-of-the-art benchmarks to solve real-world problems
- Communicator. Strong verbal and written communication skills are essential to ensure effective collaboration and timely delivery of results within the team
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.