AWS Data and Integration Engineer
RemoteIndia
Job Summary
Design and build data pipelines to extract, transform, and load data from IWMS systems like TRIRIGA, ARCHIBUS, and Planon into AWS RDS. Develop integration adapters using web services and custom functions in Java or Python, leveraging AWS Lambda, Glue, Step Functions, and S3 for orchestration. Implement frameworks for batch and near real-time ingestion while enforcing best practices for auditing, error handling, Row-Level Security, and operational logging. Collaborate with business analysts and technical stakeholders to define data mapping and transformation logic, then proactively troubleshoot workflows to ensure performance, scalability, and reliability. Maintain data accuracy, consistency, and traceability across all processes while adhering to security and compliance standards.
Required Qualifications
- 3-7 years of experience as an AWS Data Engineer
- Strong hands-on experience with AWS services like Glue, Lambda, RDS, Step Functions, and S3
- Proficiency in developing integration solutions using Web Services (REST/SOAP) and building custom adapters using Java or Python
- Strong expertise in SQL and Python for data processing, transformation, and workflow orchestration
- Experience handling JSON, XML, and API-based integrations
- Familiarity with enterprise data integration practices, including auditing, error handling, and enforcing data security policies like RLS
- Experience integrating data from IWMS or ERP platforms
Desired Qualifications
- Prior experience with IWMS platforms such as IBM TRIRIGA, ARCHIBUS, or Planon
- Familiarity with big data technologies like Spark, Hive, or PySpark
- AWS certification (e.g., AWS Certified Data Analytics Specialty, Solutions Architect, or Developer Associate)
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.