Lead Data Engineer
On-siteDubai, Dubai, United Arab Emirates
Job Summary
Design, develop, and maintain scalable data pipelines and integration solutions while leading data engineering initiatives and providing technical guidance to team members. Optimize data processing, storage, and performance across cloud-based data lakes and warehouses, ensuring implementation of data governance, security, and quality standards. Collaborate with business and technical stakeholders to define data requirements for enterprise analytics and reporting. This role requires 7-8 years of experience in ETL/ELT development with proficiency in SQL and hands-on expertise in Informatica IDMC, Microsoft Fabric with Purview, or Databricks.
Required Qualifications
- 7-8 years of experience in Data Engineering
- Strong experience in ETL/ELT development and data integration
- Proficiency in SQL and data warehousing concepts
- Experience with cloud-based data platforms, data lakes, and data warehouses
- Hands-on experience with at least one of the following technologies: Informatica IDMC, Microsoft Fabric with Purview, or Databricks
- Knowledge of Data Governance and Data Quality principles
Desired Qualifications
- Experience with Python, PySpark, or Spark
- Exposure to Azure Data Factory, Snowflake, or similar cloud technologies
- Understanding of CI/CD, DataOps, and Agile methodologies
- Microsoft Certified: Fabric Analytics Engineer Associate
- Microsoft Certified: Azure Data Engineer Associate
- Databricks Data Engineer Associate/Professional
- Informatica IDMC Certification
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.