Director, Research - Evaluation & Training
On-site · San Francisco, California, United States
Job Summary
Lead and grow a team of researchers focused on data evaluation, error analysis, and data valuation to improve model performance. Own a multi-quarter roadmap, synthesize trends from model-failure analysis and benchmarking, and translate findings into recommendations on datasets and data strategy for customers. Act as the primary bridge between research insights and Product, GTM, and customer-facing teams. Require 7+ years in applied AI/ML or research and 4+ years of people management; possess depth in LLM evaluation, benchmarking, and model behavior analysis; exceptional communication to make technical results accessible; and knowledge of data valuation is a strong plus.
Required Qualifications
- 7+ years in applied AI, ML, or research roles
- 4+ years managing technical teams
- Strong business and market judgment in AI/ML space
- Technically conversant in LLM evaluation, benchmarking, model behavior analysis
- Excellent communication and storytelling skills
- N familiarity with data valuation or data attribution research is a strong plus
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.