Data Engineer
Hybrid · Chennai, Tamil Nadu, India
Job Summary
Data Engineer to join NIQ for Digital Commerce machine learning team. Responsibilities include creating data flows, implementing data versioning, launching flows in orchestration tools, improving CI/CD pipelines, managing dependencies with Poetry, deploying notebooks-based scripts/models from data scientists, and working with Python-based data tooling. Required skills include distributed big-data systems (Dask/Spark), ETL pipeline development, GCP data services (BigQuery, Cloud Storage, Cloud Build, GKE), and orchestration tools (Airflow, Dagster). Proficiency in Pandas, SQL/NoSQL, Docker, and a Linux/Jupyter/Git/Docker/SQL stack, plus strong English communication. The role supports a hybrid work arrangement in Chennai, Tamil Nadu, India, with a flexible working environment and emphasis on autonomy and collaboration.
Required Qualifications
- 3-5 years of experience
- Proficiency with Python
- Experience with distributed systems to manipulate big data (Dask, Spark)
- Experience creating ETL pipelines
- Experience working with GCP (Google Cloud Platform) on main data services (cloud storage, bigquery, cloud build, GKE)
- Experience using orchestrators (Airflow, Dagster)
- Work environment (Linux, Jupyter, Python, Git, Docker, SQL, NoSQL)
- Significant experience with Pandas, SQL technologies and writing Dockerfiles
- Professional level of English
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.