Test Engineer (SC Cleared)
$50,000–$55,000 year
RemoteIndia
Job Summary
Define and manage the overall test strategy for large-scale cloud data engineering programmes operating on AWS-native ecosystems. Lead end-to-end testing activities across automated pipelines, data workflows, and distributed systems while establishing quality standards and governance processes. Design scalable automated test frameworks integrated into GitLab CI/CD pipelines and oversee PySpark-based data validation on AWS EMR. Collaborate with engineering and DevOps teams to ensure quality is embedded throughout the delivery lifecycle, driving root cause analysis for production defects and communicating risks to stakeholders. Provide leadership and mentoring to QA teams within an Agile environment.
Required Qualifications
- Proven experience as a Test Manager, Lead Test Engineer, or QA Lead within cloud and data engineering environments
- Strong background in automated testing for cloud-native and data-centric platforms
- Experience testing large-scale data pipelines, transformation processes, and distributed systems
- Experience managing or leading QA/testing teams in Agile delivery environments
- Strong stakeholder management and communication skills
- Experience establishing test governance, reporting, and quality metrics
- Strong problem-solving and decision-making capability
- Experience working within regulated or security-conscious delivery environments
- SFIA Level 5 capability
- Active SC clearance
Desired Qualifications
- Strong proficiency in Python, SQL, Java, and scripting languages such as Bash
- Hands-on experience testing Big Data platforms and Data Lake solutions
- Strong experience with AWS EMR, Apache Airflow, and Jupyter Notebooks
- Experience performing PySpark-based data interrogation, validation, and testing
- Strong knowledge of AWS services including S3, Glue, Athena, EMR, CloudWatch, IAM, DynamoDB, EC2, and ECR
- Experience designing, implementing, and managing enterprise-scale automated test frameworks
- Strong understanding of CI/CD practices using GitLab pipelines
- Experience with infrastructure-as-code tools such as Terraform
- Familiarity with Docker and containerised testing environments
- Understanding of dimensional data models and slowly changing dimensions
- Experience validating structured and unstructured data workflows
- Strong analytical and root cause analysis skills
- Ability to communicate technical risks clearly to stakeholders at all levels
- Experience leading and mentoring QA/Test Engineering teams
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.