Sr. Data Engineer - (RealTime Streaming)
On-siteBengaluru, Karnataka, India
Bengaluru, Karnataka, IndiaOn-siteFull TimeSenior LevelSmall
Full TimeSenior LevelSmall
Job Summary
Design, develop, and manage Kafka-based real-time streaming architectures handling high-volume, low-latency workloads. Build and maintain scalable pipelines using Kafka Connect, ksqlDB, Schema Registry, Apache Flink, Java, and PySpark. Perform cluster setup, administration, tuning, and monitoring while implementing disaster recovery and fault-tolerance strategies. Automate infrastructure provisioning with Terraform and GitOps, enforcing security standards like SSL/mTLS, SASL, and ACL management. Collaborate with cross-functional teams to deliver enterprise-grade solutions aligned with business requirements.
Required Qualifications
- Apache Kafka
- Apache Flink
- Java
- PySpark
- Real-Time Streaming Architecture
- Kafka Cluster Management
- Kafka Connect
- ksqlDB
- Schema Registry
- Streaming Data Pipelines
- Cloud-Native Applications
- Terraform
- Infrastructure-as-Code (IaC)
- GitOps
- High Availability & Disaster Recovery
- Performance Tuning & Optimization
- Fault Tolerance & Scalability
- SSL / mTLS
- SASL
- ACLs
Desired Qualifications
- Strong experience in building enterprise-grade real-time data platforms
- Hands-on experience working in high-throughput and low-latency environments
- Experience with large-scale distributed data processing systems
- Exposure to cloud platforms and modern DevOps practices
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.