Lead Data Engineer
HybridGurugram, Haryana, India
Job Summary
Lead the greenfield data platform by embedding AI across the data lifecycle, designing robust pipelines, and implementing Data Lake, Warehouse, and Lakehouse solutions. Ensure data quality, integrity, and governance while monitoring performance and optimizing batch and real-time workflows using AWS services, Apache Airflow, and Flink. Mentor a team of data engineers, review technical implementations, and collaborate with cross-functional stakeholders to translate business requirements into scalable data-driven initiatives. Drive design principles, documentation, and continuous learning within a growing hospitality technology team.
Required Qualifications
- Bachelor's degree in computer science, Information Systems, or a related field
- Master's degree
- AI-first mindset
- design-thinking
- innovative personality
- technical ownership
- seasoned Data Engineer or emerging data architect
- minimum of 8-10 years of experience
- Deep experience in designing and building robust, scalable data pipelines
- both batch and real-time
- using modern data engineering tools and frameworks
- Proficiency in AWS Data Services (S3, Glue, Athena, EMR, Kinesis etc.)
- Strong grip on SQL queries
- various file formats like Apache Parquet, Delta Lake, Apache Iceberg or Hudi
- CDC patterns
- Experience in stream processing frameworks like Apache Flink or Kafka Streams
- any other distributed data processing frameworks like pySpark
- Expertise in workflow orchestration using Apache Airflow
- Strong analytical and problem-solving skills
- ability to work independently in a fast-paced environment
- In-depth knowledge of database systems
- both relational and NoSQL
- experience with data warehousing concepts
Desired Qualifications
- Hands-on experience with data integration tools
- a strong familiarity with cloud-based data warehousing and processing
- Excellent communication and interpersonal skills
- facilitating effective collaboration with both technical and non-technical stakeholders
- A strong desire to stay current with emerging technologies
- industry best practices in data landscape
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.