Data Engineer
On-siteChennai, Tamil Nadu, India
Job Summary
Design, develop, and maintain scalable ETL/ELT data pipelines to support business and analytics needs while writing, tuning, and optimizing complex SQL queries for data transformation. Translate business requirements into documented, reusable solutions and partner with analysts and data scientists to deliver accurate datasets. Automate workflows using orchestration tools like Airflow or ADF, and develop unit and integration tests to ensure pipeline reliability. Document design decisions, apply coding standards, and proactively troubleshoot issues for performance and cost efficiency. Support function rollouts with post-production monitoring and issue resolution. Requires a Bachelor's degree, 2–5 years of data engineering experience, and 3+ years in complex SQL within a cloud data warehouse environment.
Required Qualifications
- Bachelor's degree in computer science, Information Systems, Engineering, or a related field
- 2–5 years of hands-on experience in data engineering and building data pipelines
- At least 3 years of experience in writing complex SQL queries in a cloud data warehouse/ data lake environment
- Solid hands-on experience with data warehousing concepts and implementations
- At least 1 year of experience with Snowflake or another modern cloud data warehouse
- At least 1 year of hands-on Python development
- Familiarity on Data modeling and Data warehousing concepts
- Experience with orchestration tools (e.g., Airflow, ADF, Luigi)
- Familiarity with at least one cloud platform (AWS, Azure, or GCP)
- Strong analytical, problem-solving, and communication skills
- Ability to work both independently and as part of a collaborative team
Desired Qualifications
- Experience with DBT (Data Build Tool) for data transformations
- Exposure to real-time/streaming platforms (Kafka, Spark Streaming, Flink)
- Familiarity with CI/CD and version control (Git) in data engineering projects
- Exposure to the e-commerce or customer data domain
- Understands the technology landscape, up to date on current technology trends and new technology, brings new ideas to the team
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.