Senior Associate
On-siteCoimbatore, Tamil Nadu, India
Job Summary
Design, develop, and maintain scalable data pipelines using Python, SQL, and Snowflake while implementing automated data quality checks and ingestion processes from databases and APIs. Build and manage cloud infrastructure on AWS, Azure, or GCP using Terraform and Infrastructure as Code principles, ensuring data integrity through rigorous monitoring. Collaborate with data scientists and analysts to translate requirements into technical solutions, manage version control via Git, and document all pipeline processes for knowledge sharing. This role requires 6 to 8 years of experience and is based in Coimbatore with an office work requirement.
Required Qualifications
- 6 years of experience in data engineering or a related field
- Proven experience in designing, developing, and deploying data pipelines
- Hands on experience with Snowflake, DataBricks, Python or Pyspark and SQL
- Should have experience working in Data Build Tool (DBT) with snowflake is required
- Experience with data warehousing and data modelling concepts
- Working knowledge of Terraform and Infrastructure as Code (IaC) principles
- Experience with Git for version control
- Excellent communication and collaboration skills
- Ability to work independently and as part of a team
- Strong problem-solving and analytical skills
Desired Qualifications
- Experience with cloud platforms (AWS, Azure, GCP)
- Experience with data orchestration tools (Airflow, Luigi, etc.)
- Experience with data visualisation tools (Tableau, Power BI, etc.)
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.