User Researcher, AI Evaluations
$196,000–$230,000 year
HybridNew York City, New York, United States or San Francisco, California, United States
Job Summary
Notion is seeking a User Researcher focused on AI Evaluations to define and scale how Notion evaluates AI-powered experiences, including model output quality and end-to-end product usability. You’ll run longitudinal and feature-specific studies, develop reusable rubrics and workflows, and partner with product, design, engineering, and data science to apply insights across teams. The role emphasizes understanding user goals, workflows, and guardrails for AI interactions, translating qualitative insights into actionable measurement, and ensuring evaluations reflect real user behavior within the product context. The position can be based in San Francisco or New York City, with in-person Anchor Days (Mondays, Tuesdays, and Thursdays). Required and preferred qualifications include strong UX research craft, experience evaluating AI-enabled products, clear cross-functional collaboration, and 5+ years of UX research experience. Notion offers competitive compensation and benefits, with base salary ranges for SF/NYC roles in the $196k–$230k range.
Required Qualifications
- 5+ years of UX research in industry
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.