Social Workers (AI Conversation Evaluation)
RemoteIndia or Colombia
Job Summary
Review AI conversations involving interpersonal and advisory scenarios to assess whether sufficient context was gathered before recommendations were made. Identify missing information, propose relevant follow-up questions, and distinguish between load-bearing details and non-essential data. Conduct structured qualitative reviews using defined guidelines, document findings in spreadsheets or annotation tools, and apply consistent judgment to flag ambiguous cases. Collaborate with research and quality teams for calibration and standard improvement. This 9-week, full-time contractor role requires 40 hours weekly with 4 hours PST overlap and is based in Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Pakistan, Indonesia, Turkey, or Vietnam. Applicants need an MSW, MA/MS, or PhD in psychology, counseling, HCI, or related fields plus 5+ years of advisory experience.
Required Qualifications
- MSW with LCSW or an equivalent social-work license
- MA/MS with LMFT, LPC, LCPC, or an equivalent counseling license
- PhD or PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology
- MA or PhD in HCI, Communication, Anthropology, Sociology, Conflict Resolution, Qualitative Research, or a closely related field
- Relevant professional credential combined with at least 5 years of direct advisory, coaching, mediation, consulting, or client-facing experience
- At least 3 years of relevant professional practice
- Experience gathering missing context through interviews, assessments, consultations, or advisory conversations
- Ability to distinguish critical information from non-essential context
- Strong written English and qualitative analytical skills
- Strong attention to detail and ability to follow detailed labeling guidelines
Desired Qualifications
- 5+ years preferred for credential-based applicants
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.