Senior AI/Data Science Engineer
On-siteNanakramguda, State of Telangāna, Republic of India
Job Summary
Design, develop, deploy, and monitor the Analytics and rebuild of legacy reports within the data mart platform. Create automation tools to integrate the data platform with external systems and enable a self-service model for developers. Execute production support rotation to ensure platform uptime while troubleshooting issues and right-sizing infrastructure based on metrics. Implement CI/CD patterns for administering the data platform and analyze platform metrics to guide infrastructure optimization. Work independently to reverse-engineer existing SQL stored procedures into a cloud-native tech stack using PySpark and AWS native tools. Mentor junior engineers and collaborate with IT and business partners to improve existing processes.
Required Qualifications
- Overall, 7-12 years of IT experience
- Bachelor's degree in computer engineering, Software Engineering, Computer Science, Electrical Engineering, or related technical field
- Minimum experience of 6 years, or advanced degree with experience of 4 years
- Ability to take business requirements and work independently to deliver solutions using industry best-practice
- Strong Expertise in writing SQL Queries
- Ability to analyze, reverse-engineer, and modernize logic/transformations of existing SQL stored procedures and reporting solutions into cloud-native tech stack (Glue, Python, PySpark)
- Core Python experience (Mandatory)
- Hands-on Experience on PySpark
- Minimum 1 year of experience in AWS and AWS native tools S3, Glue, Lambda, EMR , Athena, Step Functions
- Hands-on experience using Job Orchestration tools
- Preferably AWS Step Functions, Airflow / Oozie
- Source Code systems Git/GitHub experience
- Strong problem-solving skills
- Experience automating routine tasks
- Strong written and verbal communication & presentation skills
- Strong security and data-privacy mindset
Desired Qualifications
- Experience migrating legacy SQL, SSRS Reports to modern tech stack with ETL/ELT transformations
- Working experience in CI/CD process and tools like Azure DevOps
- Working Knowledge on IaC tools like Terraform
- AWS certifications
- Previous healthcare industry experience
- can have prior experience of Bigdata Technologies like HDFS, Hive
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.