Senior Associate Data Engineering L2
On-siteBengaluru, Karnataka, India or Gurugram, Haryana, India
Job Summary
Design and deliver scalable data engineering solutions by building and optimizing batch and real-time ingestion pipelines across AWS, Azure, or GCP platforms. Implement robust processing frameworks using Spark, Kafka, Flink, and Airflow to ensure performance and scalability for analytics and business transformation. Drive architecture discussions to integrate data platforms with business applications while maintaining data security and governance standards. Collaborate with cross-functional teams to develop aggregation capabilities that enable data-driven decision-making. This role supports Publicis Sapient's mission to help clients digitally transform through modern data ecosystems and agile engineering practices.
Required Qualifications
- 6+ years of IT experience
- 3+ years in data engineering or related technologies
- Hands-on experience with Big Data technologies and cloud platform Azure
- Strong programming expertise in Scala, or Python
- Experience with Hadoop ecosystem tools such as Spark, Hive, Kafka, Flink, NiFi, and Airflow
- Working knowledge of NoSQL and MPP data platforms like MongoDB, Cassandra, Redshift, or BigQuery
- Understanding of data integration, data wrangling, analytics pipelines, and cloud data services
- Strong understanding of IAM, data security, and cloud-based data platform services
Desired Qualifications
- Experience with ETL tools such as Informatica or Talend and relational databases
- Knowledge of data governance tools and processes (Collibra, Alation, lineage, cataloging)
- Exposure to messaging frameworks like ActiveMQ, RabbitMQ, and microservices architecture
- Experience in performance tuning and optimization of data pipelines
- CI/CD practices including cloud infrastructure provisioning and automated deployment pipelines
- Relevant cloud or big data certifications
- Gen AI experience
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.