ETIC, Data Engineer, Senior Associate
On-siteCairo, Cairo, Egypt
Cairo, Cairo, EgyptOn-siteFull TimeSenior LevelEnterprise
Full TimeSenior LevelEnterprise
Job Summary
Design, develop, and maintain end-to-end data pipelines across structured, semi-structured, and unstructured sources using Azure Data Factory, Synapse, Microsoft Fabric, and Databricks. Implement ingestion, transformation, and orchestration frameworks with PySpark, SQL, and Delta Lake to ensure high performance and scalability. Enforce data quality, lineage, and governance practices while collaborating with solution architects to translate business needs into secure, compliant modern data architectures. Participate in client workshops to drive advanced analytics and AI initiatives for enterprise clients.
Required Qualifications
- 3–6 years of experience in data engineering
- Strong hands-on experience with Azure Data Platform: Data Factory, Synapse Analytics, Azure Data Lake Storage, Microsoft Fabric, Event Hub/IoT Hub, and Azure Functions
- Strong hands-on experience with Databricks: PySpark, Spark SQL, Delta Lake, Unity Catalog, and Databricks Workflows
- Proficiency in Python and SQL for large-scale data processing and transformation
- Solid understanding of data modeling, medallion architecture, and lakehouse principles
- Familiarity with CI/CD pipelines, DevOps, and version control (e.g., Git, Azure DevOps)
- Knowledge of data governance, lineage, and observability tools
- Experience with performance optimization, cost control, and best practices in cloud environments
Desired Qualifications
- Amazon Web Services (AWS)
- Apache Airflow
- Apache Hadoop
- Database Administration
- Database Management System (DBMS)
- Database Optimization
- Database Security Best Practices
- Databricks Unified Data Analytics Platform
- Data Infrastructure
- Data Integration
- Data Lake
- Data Modeling
- Data Pipeline
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.