Senior Product Quality Analyst - AI Voice
On-siteLondon, England, United Kingdom
Job Summary
Define and measure quality standards for Spotify's AI voice models across naturalness, tone, and pronunciation. Design evaluation rubrics and run campaigns to turn qualitative and quantitative findings into actionable recommendations for Voice Production and technical teams. Benchmark internal models against third-party competitors to identify gaps and opportunities for improvement. Establish ongoing evaluation rhythms and determine quality trade-offs for new languages and regions. Partner with machine learning, product, and vendor teams to maintain a consistent quality bar while surfacing insights that influence future research priorities.
Required Qualifications
- experience in product quality, evaluation, data curation or a closely related field where human judgment is used to assess model or product performance
- ability to independently define evaluation criteria and turn subjective qualities into clear, repeatable rubrics
- comfort designing and running both qualitative and MOS-style evaluations and synthesizing the results into actionable insights
- understanding of voice or audio quality, including qualities such as naturalness, pacing, tone, accent and pronunciation, or the ability to develop that expertise quickly
- strong judgment and can maintain a consistent quality bar while balancing different product requirements, markets and stakeholder perspectives
- comfortable working autonomously, identifying what needs to be evaluated and establishing the processes and cadence to make that evaluation useful over time
- ability to communicate clearly across creative, technical and product teams and can act as a reliable point of contact for internal partners and external vendors
- curiosity about generative AI, speech technology and the evolving AI voice landscape and can translate changes in the industry into meaningful benchmarks for Spotify
- This role is based in London
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.