Lead Software Engineer (Big Data)
HybridBengaluru, Karnataka, India or Pune, Maharashtra, India
Bengaluru, Karnataka, India or Pune, Maharashtra, IndiaHybridFull TimeSenior LevelMasters DegreeLarge
Full TimeSenior LevelMasters DegreeLarge
Job Summary
Design and optimize ETL/ELT pipelines using PySpark, Python, and SQL while architecting data warehouse solutions on cloud platforms like AWS, Azure, or GCP. Collaborate with cross-functional teams to deliver high-quality data solutions, ensure data quality and governance, and drive performance tuning and cost optimization. Mentor junior engineers, participate in Agile ceremonies, and contribute to enhancing in-house data tools and frameworks. This role requires 4–7 years of experience in data engineering with a focus on cloud-based solutions and is located in Bangalore or Pune.
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, or related field
- 4–7 years of experience in data engineering, with a strong focus on cloud-based data solutions
- Proficiency in Python, PySpark, and SQL for data processing and transformation
- Hands-on experience with Cloud platforms (AWS, Azure, or GCP) and their data services
- Solid understanding of data warehousing concepts, dimensional modeling, and data architecture
- Experience with version control (Git), CI/CD pipelines, and Agile methodologies
- Ability to quickly learn and adapt to internal tools and technologies
- Experience with orchestration tools like Apache Airflow
- Knowledge of data visualization tools (e.g., Power BI, Tableau)
- Strong communication and leadership skills
- Stay Curious: Being hungry to learn and grow, always asking the big questions
- Seek Clarity: Embracing complexity to create clarity and inspire action
- Own the Outcome: Being accountable for decisions and taking ownership of our choices
- Center on the Client: Relentlessly adding value for our customers
- Be a Challenger: Never complacent, always striving for continuous improvement
- Champion Inclusivity: Fostering trust in relationships engaging with empathy, respect and integrity
- Commit to each other: Contributing to making Circana a great place to work for everyone
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.