Lead Data Engineer
On-siteLahore, Punjab, Pakistan
Job Summary
Design, develop, and maintain scalable data pipelines and integration solutions while optimizing data processing, storage, and performance. Lead data engineering initiatives, provide technical guidance to team members, and collaborate with business and technical stakeholders to define data requirements. Ensure implementation of data governance, security, and quality standards across cloud-based platforms. Requires 7-8 years of experience in ETL/ELT development with proficiency in SQL, data warehousing, and technologies such as Informatica IDMC, Microsoft Fabric, or Databricks. Familiarity with Python, PySpark, CI/CD, and Agile methodologies is preferred.
Required Qualifications
- 7-8 years of experience in Data Engineering
- Strong experience in ETL/ELT development and data integration
- Proficiency in SQL and data warehousing concepts
- Experience with cloud-based data platforms, data lakes, and data warehouses
- Hands-on experience with at least one of the following technologies: Informatica IDMC, Microsoft Fabric with Purview, or Databricks
- Knowledge of Data Governance and Data Quality principles
Desired Qualifications
- Experience with Python, PySpark, or Spark
- Exposure to Azure Data Factory, Snowflake, or similar cloud technologies
- Understanding of CI/CD, DataOps, and Agile methodologies
- Microsoft Certified: Fabric Analytics Engineer Associate
- Microsoft Certified: Azure Data Engineer Associate
- Databricks Data Engineer Associate/Professional
- Informatica IDMC Certification
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.