Senior Data Engineer - AWS, Spark, Scala, Big Data & GenAI
On-siteBengaluru, Karnataka, India or Pune, Maharashtra, India
Bengaluru, Karnataka, India or Pune, Maharashtra, IndiaOn-siteFull TimeSenior LevelEnterprise
Full TimeSenior LevelEnterprise
Job Summary
Design and deliver end-to-end data solutions aligned to business objectives by building scalable ETL pipelines and data architectures on AWS using Spark and Scala. Lead or contribute to technical design and implementation while collaborating with business, operations, and engineering teams to influence stakeholders on secure, scalable, and highly available solutions. Participate in Agile delivery from ideation to production, driving engineering best practices and continuous improvement while ensuring alignment with enterprise risk and governance standards.
Required Qualifications
- 9+ years of experience in Data Engineering, Analytics, or Data Warehousing
- Spark
- Scala
- Big Data platforms
- AWS cloud data engineering
- ETL pipeline development
- Oracle SQL / PL-SQL
- Teradata
- Hadoop
- Hive
- Python
- GenAI frameworks such as Lang Chain, Llama, Hugging Face etc.
- Adhere to Sustainability and Health Safety standards
Desired Qualifications
- Python (preferred)
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.