Data Engineer, Specialist
On-siteHyderabad, Telangana, India
Job Summary
Write ETL processes, design database systems, and develop tools for real-time and offline analytic processing. Troubleshoot software and processes for data consistency and integrity. Integrate large-scale data from various sources to generate insights for business partners. Translate business specifications into design specifications and code, ensuring all programs are well-structured, documented, and reusable. Partner with internal clients to understand business functions and informational needs. Lead all phases of solution development, explain technical considerations at meetings, and test code thoroughly for accuracy. Conduct training sessions on tools and data sources, provide job aids to team members, and implement new software releases through regression testing. Identify issues and engage with vendors to resolve problems before elevating software into production.
Required Qualifications
- Minimum 5 years of relevant work experience
- At least 2 years in designing and maintaining data pipelines, ETL processes and database architectures
- Bachelor's or master's degree in computer science, Information Technology, or related field
- 5–8 years of experience in data engineering, analytics engineering, or data platform development
- Strong proficiency in SQL and Python for data transformation and automation
- Hands-on experience building and supporting ETL/ELT pipelines
- Experience with AWS or similar cloud data platforms
- Solid understanding of data modeling, curated datasets, and BI/reporting use cases
- Ability to communicate effectively with both technical and non-technical stakeholders
- Experience working in collaborative, agile team environments
- A quality-first mindset, with experience building reliable, scalable, and observable systems
- Comfort using AI-assisted engineering tools to improve developer productivity, code quality, and delivery flow
- Proficiency in DevOps concepts, tools and continuous delivery pipelines, specifically Git and GitHub
- Proficiency in Event Driven Architecture (Medallion Architecture)
- Proficiency in AWS technologies: CloudFront, S3, ECS, IAM, DynamoDB, Lambda, SNS, SQS, Glue, Step functions, Athena, PySpark and CloudWatch
- Proficiency in GenAI tools
Desired Qualifications
- Preferred Certifications - AWS Cloud Practitioner, AWS Solutions Architect, AWS Solution Consultant, Databricks
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.