Senior Data Engineer
On-siteNeelankarai, Tamil Nadu, India
Job Summary
Design, build, and maintain scalable data pipelines and ETL processes using Azure Data Factory, AWS Glue, and database scripts across Azure and AWS cloud environments. Own the development of enterprise BI and reporting solutions with Amazon QuickSight and Microsoft Azure BI, while implementing robust user access controls and data security measures. Assist with tabular and multi-dimensional modelling for the Enterprise Data Warehouse, leveraging both cloud platforms to drive business decisions. Coordinate with management and end-users to evaluate needs, identify cost-optimization opportunities, and present recommendations for cross-cloud analytics improvements. Develop and execute comprehensive system and unit testing to validate quality and compatibility between environments. Requires 6-10 years of experience, a bachelor's degree, and strong SQL skills; preferred domain expertise includes the Automotive industry.
Required Qualifications
- 6 -10 years of experience in data engineering and reporting
- A bachelor's degree from an accredited college or university with a focus in Information Technology, Computer Science, or related discipline
- Strong proven track record of developing and testing database scripts, stored procedures, triggers, functions, SSIS Packages, AWS, Azure cloud services and other back-end processes to support system integration
- Experience using BI/Analytics/Statistical tools like Power BI, Tableau, SSRS, SSAS, and Excel
- Strong SQL skills
- Business intelligence tool expertise
- AWS Cloud services
- Report development skills
- Hands-on experience with Azure cloud services including Azure Data Factory, Azure SQL, Azure Blob Storage, Azure Dataflow, Logic Apps, Azure Synapse Analytics, Function Apps, and Key Vaults for building and orchestrating data pipelines, serverless integrations, and secure secrets management
- Hands-on experience with AWS cloud services including S3, Lambda, Glue, Step Functions, Redshift, Athena, SNS, SQS, EventBridge, Event Bus, SageMaker, IAM, Secrets Manager, Bedrock, CloudWatch, and Lake Formation for building scalable data engineering solutions, event-driven architectures, ML workflows, and governance of data lakes
- Understanding of configuration, deployment, and database servers
- Strong writing and verbal communication skills
- Ability to work collaboratively in a functional team environment
Desired Qualifications
- Domain expertise in Automotive industry
- Certification in AWS or Azure services
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.