Principal Quality Development Engineer
$115,000–$164,000 year
On-siteBoston, Massachusetts, United States
Job Summary
Develop and maintain AI validation methodologies to validate non-deterministic AI-enabled applications, defining standard testing strategies for performance, security, and interoperability across various LLMs. Collaborate with Agile teams in TrakCare and HealthShare to prioritize testing efforts, lead the development of AI test strategies and detailed plans, and design custom tools for UI, API, and AI/ML validation. Evaluate and optimize LLM performance regarding accuracy, safety, and hallucination detection while providing governance across AI validation activities with stakeholder oversight. Research industry developments in the AI space and support QD teams with test design, execution, triage, and reporting practices to deliver high-caliber work.
Required Qualifications
- Tertiary qualification in Computer Science or related discipline
- 3+ years professional experience
- Comprehensive understanding of AI tools' capabilities and limitations
- A flexible and adaptable approach to learning and developing new methodology, technologies and software products
- Possesses intellectual curiosity and have a collaborative and personable demeanor
- Experience working with interdisciplinary teams
- Good understanding of the SDLC and software testing principles
- Qualifications and/or certifications in AI
- Technical proficiency in multiple programming languages
Desired Qualifications
- System administration or DevOps experience is advantageous
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.