Head of AI Quality, Assurance and Evaluation
On-siteSanta Clara, California, United States
Job Summary
Design and implement risk-based governance frameworks, evaluation methodologies, and compliance controls to enable the safe, scalable deployment of AI models, agents, and applications. Conduct AI risk, bias, transparency, privacy, and compliance assessments while establishing audit-ready evaluation frameworks, monitoring, and observability standards. Translate legal, quality, security, privacy, and regulatory requirements into measurable and testable controls throughout the AI lifecycle. Collaborate with cross-functional teams including engineering, data science, product, legal, quality, and compliance to embed responsible AI principles into development workflows and mitigate ethical and operational risks. Ensure technical architecture fit for audit and policy via Eval suites, benchmark sets, regression gates, and production observability. Develop policies, standards, documentation, and training programs to promote ethical AI awareness and drive continuous improvement of deployment practices.
Required Qualifications
- Experience building or operating ML/LLM evaluation infrastructure in production, not only authoring policy
- Bachelor's or Master's Degree or equivalent
- Post-graduate, certification, and/or license
- Typically, at least 10+ years relevant experience for entry to this level
- Working knowledge of regulated computerized systems; GxP, Part 11, or equivalent validation experience
Desired Qualifications
- Working knowledge of regulated computerized systems; GxP, Part 11, or equivalent validation experience strongly preferred
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.