Lead Data Engineer
On-siteBhubaneswar, Odisha, India
Job Summary
Develop, maintain, and optimize data pipelines using Azure Data Factory for efficient data ingestion and ETL processes. Design scalable data models to meet analytical and operational needs while managing large datasets to ensure quality, integrity, and compliance with healthcare regulations. Troubleshoot data-related issues and assist in managing the Informatica governance platform, including cataloging, metadata management, and lineage. Implement data governance policies and participate in quality initiatives to maintain accuracy across datasets. Collaborate with onshore team members, maintaining overlapping working hours until at least 11am EST for seamless communication.
Required Qualifications
- 4+ years of relevant experience in data engineering
- Experience with Azure Data Lakehouse architecture for data storage and analytics
- Skilled in developing, maintaining, and optimizing data pipelines using Azure Data Factory for data ingestion and ETL processes
- Ability to design and implement efficient data models that meet analytical and operational requirements
- Knowledge of using Informatica for data governance, including data cataloging, metadata management, and data lineage
- Familiarity with data governance implementation and policy enforcement
- Experience in maintaining data accuracy, integrity, and consistency across large datasets
- Understanding of healthcare industry standards and regulations such as HIPAA to ensure data security and compliance
- Proficiency in SQL and possibly other programming languages like Python or Scala used in data engineering
- Ability to manage and organize large volumes of data efficiently
- Knowledge of best practices for securing sensitive data within cloud environments
- Bachelor's degree in Computer Science, Information Technology, or a related field
- Available online until at least 11am EST
Desired Qualifications
- Relevant certification (e.g., Microsoft Certified: Azure Data Engineer Associate)
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.