Italian - AI Model Rater
Remote
Job Summary
Conduct structured evaluations of AI chatbots and language models through written conversations and voice-based interactions to assess capabilities, safety, and helpfulness. Submit deliverables including write-ups, ratings, screenshots, or recordings per specific task specifications outlined in the Statement of Work. Engage in iterative project batches where work arrives in groups with potential pauses between them. This role requires native or expert-level Italian fluency and hands-on experience with large language models. Applicants must be independent contractors based outside the U.S., able to start within 48 hours, and set their own flexible hours while working alongside other clients.
Required Qualifications
- Native or expert-level fluency in Italian, as spoken in Italy
- Strong English reading, writing, and communication skills
- 18 years of age or older
- Hands-on experience using AI models or large language models
- Comfortable with both written and voice-based conversation
- Good at asking sharp follow-ups
- Own smartphone
- Computer
- Reliable internet
- Comfort with web-based tools
- Able to pass a language proficiency assessment
- Able to pass an AI evaluation task
- Responsive communicator
- Able to start within 48 hours
- Independent contractor engagement (task-based - project-based)
- Open to freelancers based outside the U.S.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.