Senior Product Operations Manager, Evaluation
$150,000–$210,000 year
Remote · San Francisco, California, United States
Job Summary
Build and scale the evaluation engine behind Harvey’s platform. As part of the Product Operations team, you’ll work closely with Applied Legal Researchers, Product, Engineering, AI Research, and human data providers to operationalize evaluation methodologies and embed them into the product development lifecycle. You’ll create workflows, systems, and tooling that make evaluation a first-class product capability, drive intake triage and prioritization for evaluation requests, embed evaluation workflows into development cadence, establish a single source of truth for evaluation status and readiness, translate expert-designed methodologies into scalable processes, and manage internal contract-attorney pipelines to ensure evaluation quality meets legal standards. You’ll collaborate with Engineering and Research to improve tooling, automation, and dashboards, drive evaluation readiness for global launches across geographies and jurisdictions, and define governance to maintain model accuracy, reliability, and trust at scale.
Required Qualifications
- 4–7+ years in technical program management, product operations, research operations, or evaluation/benchmarking roles
- Experience working with ML/AI evaluations, benchmarking frameworks, or scientific workflows
- Comfort with statistical methodologies and SQL or Python
- Strong business acumen with ROI-focused mindset
- Ability to work with legal experts and operationalize complex evaluation methodologies
- Strong cross-functional coordination across Product, Engineering, Research, and data providers/vendors
- High attention to detail and a bias toward clarity, rigor, and reproducibility
- Ability to navigate evolving landscapes and bring order to complex systems
- Strong communication skills and ability to translate technical nuance for diverse stakeholders
- Willingness to write documentation and diagnose pipeline issues
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.