Remote Domain Expert - Video Games (US Only)
RemoteUnited States
Job Summary
Design challenging prompts covering game development, esports, platforms, game design, publishers, and communities. Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance. Identify hallucinations, logical inconsistencies, outdated information, and edge cases. Develop benchmark datasets and adversarial test cases while providing evidence-based feedback with reliable references. Collaborate with AI researchers to improve model performance and maintain high annotation quality and documentation. Commit to 40 hours per week with at least 4 hours PST overlap for an 8-week contract. Located in the United States.
Required Qualifications
- Master's degree or higher in any field
- Strong knowledge of the video games industry, including game development, game design principles, gaming platforms, genres, publishers, studios, esports, gaming communities, and current industry trends
- 3+ years of relevant professional experience, preferably in game development, game design, QA, esports, gaming journalism, content creation, research, community management, or a related field
- Excellent written English, research, and analytical skills
- Strong attention to detail and ability to evaluate gaming-related information accurately, identify factual inconsistencies, and assess reasoning across a wide range of video game topics
- Commitments Required: 40 hours per week with at least 4 hours PST overlap
- Employment type : Contractor assignment (no medical/paid leave)
- Duration of contract : 8 weeks
- Location Must be currently based in the United States
Desired Qualifications
- degrees in Game Design, Game Development, Computer Science, Interactive Media, Digital Arts, Software Engineering, Animation, or other gaming-related disciplines
- Experience with LLMs, Generative AI, prompt engineering, or AI evaluation
- Published research, industry recognition, or teaching experience
- Ability to work independently and provide objective, evidence-backed reviews
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.