Data Engineer- Azure Databricks- Senior Associate
On-site · Bengaluru, Karnataka, India
Job Summary
Senior Associate Data Engineer at PwC Acceleration Centers who designs and builds data solutions using Azure Databricks to enable client data processing and analytics. Responsibilities include designing and developing data pipelines, data integration and transformation solutions, mentoring junior engineers, collaborating with cross-functional teams, maintaining data governance and security, and producing architecture and operations documentation. The role emphasizes cloud data migration, DevOps practices, and leveraging big data frameworks (Hadoop/Spark) with expertise in SQL, Unix scripting, and Python. Bachelor's degree and 4+ years of related experience required.
Required Qualifications
- Bachelor's Degree in Engineering, MCA, M.Sc, M.E, M.Tech, MBA
- 4 years of experience in Azure ADLS, Data Bricks, Data Flows, HDInsight, Azure Analysis Services
- Experience in Hadoop and Spark
- Experience in extracting data from multiple sources (flat files, XML, JSON, Parquet, RDBMS)
- Strong SQL skills; knowledge of joins, groups, functions, and stored procedures
- Experience in Unit and Integration Test creation and verification
- Proficient in project documentation (Architecture, End User Manual, Operations Hand-off)
- Understanding of Data Migration processes and project lifecycle
- Unix Shell Scripting
- Analytical and troubleshooting skills
- Knowledge of Cloud data migration, DevOps tools (Git, CI/CD, Code Pipeline/Build/Commit)
- Excellent communication skills
- Travel not specified
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.