QA Engineering, Test Orchestration
RemoteUnited States
Job Summary
Design, build, and operate AI-driven testing workflows using agents and orchestration to expand coverage and accelerate feedback. Develop and maintain an end-to-end regression strategy, including test prioritization, risk-based coverage, and suite maintainability. Partner with Release to define testing procedures, quality gates, exit criteria, and go/no-go recommendations for production readiness. Optimize regression testing through intelligent test selection, parallelization, flaky-test remediation, and risk-based coverage. Collaborate with Product and Engineering teams to improve testability, failure observability, and signal-to-noise within CI/CD pipelines. Analyze release risk, failure patterns, and escaped defects to identify opportunities for additional automation and prevention. Establish and promote shared QA standards, test-design practices, and regression strategies across product teams. Use AI tooling thoughtfully by prompting, evaluating, and governing agentic test generation and triage to ensure results remain accurate and trustworthy. Mentor QA peers and help engineering teams adopt modern testing and quality practices. Participate in release readiness reviews and post-incident learning sessions to strengthen future prevention.
Required Qualifications
- Proven experience owning QA strategy, test automation, and release readiness within production software environments
- Strong knowledge of test orchestration, including coordinating multi-step test pipelines, agents, jobs, and environments across CI/CD and release processes
- Demonstrated ability to design regression suites that balance comprehensive coverage with speed through test selection, sharding, prioritization, and parallel execution
- Strong foundation in test design, including risk-based testing, exploratory testing, automation frameworks, and failure triage
- Hands-on experience with AI-assisted testing, agentic workflows, or LLM-enabled quality tooling
- Experience partnering with Release or DevOps teams on testing procedures, quality gates, and production readiness criteria
- Ability to operate effectively in ambiguity and make clear trade-offs between coverage, speed, and release risk
- Strong written and verbal communication skills, with the ability to communicate quality status, risk, and recommendations to both technical and non-technical partners
- A systems-minded approach to quality, with a focus on building scalable processes rather than creating testing bottlenecks
- Alignment with StrongMind's core values: Kindness, Accountability, Collaboration, Innovation, and Grit
- This position requires availability to work core business hours of 8:00 AM to 5:00 PM Arizona time, Monday through Friday
Desired Qualifications
- Experience with Playwright, Cypress, Selenium, or similar end-to-end testing frameworks at scale
- Familiarity with cloud-based CI/CD and distributed test execution, including GitHub Actions, AWS, or similar technologies
- Experience reducing flaky tests and improving pipeline reliability and signal quality
- Experience defining QA standards, playbooks, or cross-team quality frameworks
- Experience evaluating AI-generated tests for correctness, coverage value, and maintainability
- Experience in EdTech or other mission-driven product environments
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.