Infrastructure Engineering - Linguist III
On-site · New York City, New York, United States
Job Summary
Perform linguistic analyses on large datasets, including linguistic error analysis of AI model outputs to identify frequent and severe error categories. Write and revise guidelines for human annotation and AI projects (e.g., translation tasks). Conduct typological and sociolinguistic research across many languages, highlighting similarities and differences. Evaluate Responsible AI aspects (toxic language, hate speech, gender bias, and cultural biases) in massively multilingual settings. Conduct literature reviews in NLP-adjacent topics and summarize findings. Compare quality of deliveries between vendors, identify error patterns, and provide actionable feedback. Provide guidance on linguistic knowledge (typology, morpho-syntax, sociolinguistics, corpus linguistics, writing systems, pragmatics, phonology) and reach out to collaborate with native speakers in various languages. Communicate results to engineers and research scientists.
Required Qualifications
- Graduate degree in Linguistics or related field is required
- Must have very firm grasp of language typology, syntax, morphology, sociolinguistics (dialectology and discourse analysis), corpus linguistics, writing systems, pragmatics, phonology
- Must have some experience applying basic Natural Language Processing techniques
- Must be able to code in Python and SQL
- Experience collaborating with machine learning, NLP, or software engineers, or data scientists
- Experience contributing to research papers
- Preferably no known conflicts of interest in related NLP/LLM fields
Desired Qualifications
- Graduate degree in Linguistics or related field
- background or specialization in corpus linguistics is a plus
- experience with field work is a plus
- experience contributing to research papers
- preferably no known conflicts of interest in the fields of machine translation, ASR, TTS, or LLM research
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.