Senior Big Data Engineer
On-sitePune, Maharashtra, India
Pune, Maharashtra, IndiaOn-siteFull TimeSenior LevelBachelors DegreeLarge
Full TimeSenior LevelBachelors DegreeLarge
Job Summary
Design, build, and maintain high-throughput data platform and pipeline components using Spark and Kafka. Debug, tune, and optimize Spark jobs and Kafka pipelines to manage growing data volumes. Collaborate with product, professional services, and sales engineering teams on architecture design and technical trade-offs. Establish and refine technical standards, system documentation, and best practices across the engineering team. Mentor junior and mid-level engineers on complex technical issues and pipeline performance.
Required Qualifications
- Minimum 5 years of experience in data engineering or big data platform development
- Bachelor's degree in Computer Science, Computer Engineering, or a related technical field
- Demonstrated experience designing, building, and optimizing distributed pipelines using Apache Spark and Apache Kafka
- Hands-on experience scaling data platform infrastructure to process high-volume/high-throughput transaction workloads
Desired Qualifications
- Experience working with high-volume, multi-tenant enterprise platform environments
- Proficiency in Scala, Java, or Python for data processing applications
- Proven experience mentoring junior or mid-level engineering team members
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.