Urdu - AI Model Rater
Remote
RemoteContractMedium
ContractMedium
Job Summary
Conduct structured evaluations of AI chatbots and language models through written conversations and voice-based interactions to assess capabilities, safety, and helpfulness. Submit deliverables including write-ups, ratings, screenshots, or recordings as specified in each project's Statement of Work. Interact directly with various AI models using assigned goals and prompts to generate insights that inform model development and optimization. This independent contractor role requires native Urdu fluency and hands-on AI experience. Apply once to be considered for future task-based projects with flexible scheduling.
Required Qualifications
- Native or expert-level fluency in Urdu, as spoken in Pakistan
- Strong English reading, writing, and communication skills
- 18 years of age or older
- Hands-on experience using AI models or large language models
- Comfortable with both written and voice-based conversation
- Able to pass a language proficiency assessment and AI evaluation task
- Responsive communicator
- Able to start within 48 hours
- Your own smartphone
- Computer
- Reliable internet
- Comfort with web-based tools
- Independent contractor engagement (task-based - project-based)
- Open to freelancers based outside the U.S.
Desired Qualifications
- Good at asking sharp follow-ups
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.