Data Engineering - Senior / Lead Engineer
On-site · Noida, Uttar Pradesh, India
Job Summary
Data Engineering – Senior / Lead Engineer role focusing on building and expanding big data platforms. Responsibilities include working on complex technical projects, designing and developing real-time data ingestion pipelines, transforming raw data into reliable components of a data lake, and implementing Hadoop ecosystem solutions. Must have hands-on experience with Hadoop, Spark, PySpark, Python/Java/Scala, and familiarity with NoSQL databases, streaming tech, and cloud services. Be a brand ambassador for Paytm and contribute to scalable, low-latency data infrastructure.
Required Qualifications
- 4 to 8 years of experience in Big Data technologies
- Experience with Hadoop Eco-System (Hadoop, MapReduce, Hive, Spark, PySpark)
- Excellent programming/debugging skills in Python/Java/Scala
- Experience with scripting languages such as Python, Bash
- Experience with noSQL databases like HBase, Cassandra
- Experience with multithreaded programming
- Experience with databases, SQL, and messaging queues like Kafka
- Experience with streaming applications (Spark Streaming, Flink, Storm)
- Experience with AWS and cloud technologies (S3)
- Experience with caching architectures like Redis
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.