Product Analyst, AI Quality
$81,000–$105,600 year
RemoteUnited States
Job Summary
Run evaluation of model outputs and training runs against agreed criteria, making go/no-go recommendations. Convert product requirements into concrete, ML-team-actionable specs including training objectives, acceptance criteria, and failure modes. Help scope datasets, write labeling guidelines, and define data quality standards alongside the ML team. Plan data acquisition to meet the ML team's needs and procure a definitive library of exemplar outputs for AI-assisted features. Coordinate resources for assessments at scale, track regressions, and serve as the first line of product-question resolution. This role bridges product intent and ML execution within CubiCasa's real estate photo-editing pipeline to maintain exemplar standards and ensure a resolved, forward-looking work queue.
Required Qualifications
- 1–5 years of experience in a product analyst, technical PM, or related operational role with exposure to data/ML
- Background in real estate photography, commercial photo editing, or visual media workflows
- Comfort evaluating structured data against defined standards and documenting reasoning clearly
- Strong written communication for writing specs and guidelines
- Organized and proactive; comfortable running planning cadences
- Familiarity with basic ML/data concepts (labeling, model evaluation)
- Experience coordinating with operations/production teams on review-at-scale work
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.