DATA ENGINEER
$300,000–$300,000 year
On-siteMaitama, Federal Capital Territory, Federal Republic of Nigeria
Job Summary
Design, develop, and maintain end-to-end ETL/ELT pipelines for structured and unstructured data using Python and SQL. Build scalable batch and near-real-time data workflows leveraging Apache Spark, Hadoop, Kafka, and Airflow across AWS, GCP, and Azure environments. Ensure high data quality through automated checks, anomaly detection, and ML-assisted monitoring while implementing governance standards and access controls. Architect cloud-based data solutions, optimize data warehouses for BI tools like Power BI and Looker, and prepare datasets for machine learning and predictive analytics. Collaborate with the Senior AI & Software Manager to translate product requirements into robust data pipelines and support ML workflows. Provide technical guidance to junior engineers and participate in delivery planning for complex, production-grade projects.
Required Qualifications
- Strong proficiency in Python and SQL for data engineering and analytics
- Hands-on experience with Apache Spark, Hadoop, Kafka, and Airflow
- Solid understanding of ETL/ELT design patterns, data modeling, and warehousing
- Experience with cloud data platforms (AWS, GCP, Azure)
- Familiarity with machine learning workflows, including data preparation and feature engineering
- Experience building APIs and services using FastAPI, Django REST, or Flask
- Working knowledge of Docker, Kubernetes, and Git
- Experience supporting BI tools such as Power BI or Looker
- Proven experience delivering large-scale, production-grade data systems
- Experience working on multi-stakeholder, high-impact projects, including government or enterprise environments
- Demonstrated ability to reduce processing time, improve data quality, and scale data operations
- Track record of translating business or AI requirements into reliable technical solutions
- Degree in Engineering, Computer Science, Statistics, or a related technical field
- SHOULD BE BASED IN ABUJA OR WILLING TO RELOCATE
Desired Qualifications
- Formal training or certification in Data Science, Big Data, or Machine Learning
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.