Data Engineer
On-siteBengaluru, Karnataka, India or Chennai, Tamil Nadu, India
Job Summary
Build, maintain, test, and optimise a scalable data architecture while performing data extractions, transformations, and loads into data platforms. Develop comprehensive knowledge of the bank's data structures and metrics, advocate for necessary changes in product development, and practice DevOps adoption through root cause analysis and issue resolution. Collaborate closely with core technology and architecture teams to build data solutions, source new data using appropriate tooling, and integrate it into the overall solution. This associate-level role focuses on driving value for customers through innovative, data-driven solutions that keep the bank's data safe and secure.
Required Qualifications
- Strong expertise in Python, PySpark, and Falcon Framework to build scalable data pipelines, process large-scale datasets, and develop high-performance RESTful APIs
- At least five years of experience in ETL, data modelling, data warehousing, and integrating data from multiple sources, with a focus on performance optimisation, reliability, data quality, security, and governance
- Proficiency in Agile/Scrum, Git, and cloud platforms such as AWS, Azure, GCP, with excellent problem-solving, collaboration, and communication skills
- Experience of using programming languages alongside knowledge of data and software engineering fundamentals
- Good knowledge of modern code development practices
- Strong communication skills with the ability to proactively engage with a wide range of stakeholders
- Good understanding of data usage and dependencies with wider teams and the end customer
- Experience of extracting value and features from large scale data
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.