Senior QA Automation Engineer
$153,000–$166,000 year
RemoteUnited States
Job Summary
Design and implement testing strategies, including agentic AI, to provide automated validation of quality metrics and gates within the system. Identify appropriate testing strategies for differing scenarios, provide expert guidance on functional and data-oriented risks, and ensure system components are built with security as a high priority. Build solutions using Agile, CI/CD, and DevOps best practices, create mock services to ensure zero dependency on other teams, and provide entry and exit points for automated services. Participate in Agile ceremonies, lead peer reviews of software engineering artifacts, and assist in the resolution of production issues. Develop a thorough understanding of customer business processes, evaluate feature requests with Architects and Engineers, and conduct testing to determine efficient system approaches. This fully remote role supports College Board's AI services infrastructure for large-scale assessment programs, enabling accurate, reliable outcomes for students and educators.
Required Qualifications
- ~7+ years of experience in software systems, testing, quality assurance and scripting/development
- Working experience with quality tools, such as Cucumber, Jest, Postman, etc.
- Familiarity with advanced testing strategies such as using test doubles (stubs, fakes, shims, mocks)
- Basic understanding of performance testing and the mechanics of operating one
- Experience applying AI for both development and testing purposes
- Experience testing code and scripting within an Amazon Web Services environment (Lambda, Step Functions, S3, Dynamo, etc.)
- Experience with CI/CD and DevOps, infrastructure and how role access works
- Experience working in Agile methodologies
- Proven ability to pitch new ideas and implement improved systems and processes
- Strong oral and written communication skills and analytical ability
- Able to function independently and in a collaborative environment
- Able to travel 3-5 times a year to our NYC or Reston, VA office
- A passion for expanding educational and career opportunities and mission-driven work
- Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and comfort with learning and applying new digital tools independently and proactively
- Clear and concise communication skills, written and verbal
- A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input
- A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking
- A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success
- Authorization to work in the United States
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.