Staff Engineer - Big Data
On-site · Bengaluru, Karnataka, India or Mumbai, Maharashtra, India
Job Summary
Design, develop, and maintain scalable data pipelines using PySpark and Apache Spark. Process and analyze large-scale structured and unstructured datasets in distributed environments. Build real-time analytics on cloud and edge devices. Solve challenging data and architectural problems using cutting-edge technology. Collaborate cross-functionally with data scientists, data engineering, and firmware controls teams. Proficiency in Java/Scala with Python a bonus; strong understanding of Kafka/Spark/Flink/Hadoop/HBase internals; experience with data wrangling, transformation, and processing of large datasets; performance tuning of Spark jobs; knowledge of cloud platforms (AWS/GCP/Azure); exposure to data lakes and warehousing concepts (SQL, NoSQL); REST APIs, gRPC; ability to adapt to new technologies and environments; learning mindset.
Required Qualifications
- 3+ years of relevant experience
- MTech/MS with emphasis in computational or decision sciences preferred
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.