Remote Domain Expert Reviewer - Sports
On-siteBengaluru, Karnataka, India
Job Summary
Review and validate domain-specific prompts covering global sports, leagues, athletes, tournaments, rules, statistics, sports history, analytics, and related topics. Evaluate completed tasks to ensure factual accuracy, reasoning quality, completeness, and compliance with project guidelines. Identify factual inaccuracies, logical inconsistencies, hallucinations, outdated information, and low-quality annotations. Provide clear, constructive, and evidence-based feedback to contributors to improve task quality while maintaining consistency across reviews. Escalate ambiguous or complex cases and document findings. Collaborate with project managers and AI teams to continuously improve evaluation quality. This 8-week contractor assignment requires 40 hours per week with at least 4 hours PST overlap. Master's degree or higher preferred, with strong sports knowledge and 3+ years of relevant experience.
Required Qualifications
- Master's degree or higher in any field
- Strong knowledge of sports, including familiarity with major leagues, teams, athletes, tournaments, rules, statistics, and key developments across one or more sports
- 3+ years of relevant professional experience, preferably in sports journalism, sports media, sports content, research, analysis, reporting, or a related field
- Excellent written English, research, and analytical skills
- Strong attention to detail and ability to assess sports-related information accurately
- Commitments Required: 40 hours per week with at least 4 hours PST overlap
- Employment type : Contractor assignment (no medical/paid leave)
- Duration of contract : 8 weeks
Desired Qualifications
- degrees in Sports Management, Sports Science, Journalism, Communications, Media Studies, or other sports-related disciplines are preferred
- Experience reviewing AI-generated content, LLM evaluations, prompt engineering, or annotation quality
- Familiarity with quality assurance, editorial review, or technical content evaluation workflows
- Strong understanding of scientific principles, technological advancements, and emerging technologies
- Ability to provide objective, evidence-based feedback while maintaining consistent quality standards
- Experience working independently in a fast-paced, quality-focused environment
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.