IN-Senior Associate _Junior Data Engineer__ D&A_ Advisory_ Noida
On-siteNoida, Uttar Pradesh, India
Job Summary
Develop and maintain data pipelines using Python and PySpark to extract, transform, and load data into cloud-based warehouses. Write and optimize complex SQL queries for business intelligence, while collaborating with senior engineers to design scalable architectures on the Databricks platform. Monitor pipeline performance, troubleshoot issues, and build automated ETL processes integrating data from APIs, databases, and file systems. Support data modeling activities by creating dimensional models and data marts for analytical reporting. Participate in code reviews, enforce version control best practices, and manage cloud infrastructure for cost optimization. This role supports clients in solving complex business problems through advanced analytics and statistical modeling within the Data, Analytics & AI practice.
Required Qualifications
- Develop and maintain data pipelines using Python and PySpark
- Write and optimize complex SQL queries
- Collaborate with senior data engineers to design and implement scalable data architecture solutions using Databricks platform
- Monitor and troubleshoot data pipeline performance issues
- Assist in building automated ETL processes
- Support data modeling activities by creating and maintaining dimensional models and data marts
- Participate in code reviews
- Follow best practices for version control, testing, and documentation
- Contribute to cloud infrastructure management tasks including resource optimization and cost monitoring
- SQL
- Python
- PySpark
- Databricks
- Cloud
- 1-4 years
- Master of Business Administration
- JSON
Desired Qualifications
- Alteryx (Automation Platform)
- Analytical Thinking
- Analytic Research
- Big Data
- Business Data Analytics
- Communication
- Complex Data Analysis
- Conducting Research
- Creativity
- Customer Analysis
- Customer Needs Analysis
- Dashboard Creation
- Data Analysis
- Data Analysis Software
- Data Collection
- Data-Driven Insights
- Data Integration
- Data Integrity
- Data Mining
- Data Modeling
- Data Pipeline
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.