Senior Data Engineer
On-siteGurugram, Haryana, India or Gurgaon, State of Jhārkhand, Republic of India
Job Summary
Lead end-to-end data architecture for a Microsoft Fabric-based sandbox environment, defining ingestion patterns, Lakehouse structure, and bronze, silver, and gold table strategies. Own technical design and implementation for data pipelines, including file validation, schema handling, partitioning, and incremental load logic. Translate raw source data into analytics-ready feature tables for pricing, underwriting, claims, fraud, and risk segmentation analysis. Implement data profiling, reconciliation, and validation outputs such as row counts, duplicate checks, and identifier stability. Partner with actuarial teams to ensure data models support business requirements and provide technical direction, design guidance, and code review for junior engineers. Establish documentation standards for data models, transformation logic, and operational procedures while coordinating with product leadership and IT/security stakeholders on environment readiness and access controls.
Required Qualifications
- Strong experience designing and implementing scalable data engineering or data architecture solutions
- Hands-on experience with Microsoft Fabric, Azure data services, Lakehouse architecture, OneLake, pipelines, notebooks, and modern cloud data platforms
- Strong understanding of bronze, silver, and gold data layer design, data modeling, data integration, and data quality frameworks
- Proficiency in SQL, Python, Spark, and data pipeline development
- Experience with schema management, incremental processing, partitioning, validation, reconciliation, and performance optimization
- Ability to translate business and actuarial requirements into robust technical data models and feature datasets
- Strong communication skills with the ability to explain technical concepts to actuarial, product, engineering, and security stakeholders
Desired Qualifications
- Experience working with insurance, actuarial, claims, pricing, underwriting, mobility, operational, or risk analytics data
- Experience integrating data from GCP or other cloud platforms into Azure or Microsoft Fabric environments
- Familiarity with data governance, access control, security configuration, and compliance-oriented data environments
- Prior experience mentoring junior engineers or leading technical delivery in a cross-functional product environment
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.