Evaluation Specialist - Language Testing
On-site · Arlington, Virginia, United States
Job Summary
The Evaluation Specialist is part of the LS/LTA unit within the Language Studies Directorate, focusing on designing and conducting quantitative and qualitative data collection and analysis for validity and reliability studies of language proficiency tests; advising on study design for quality assurance; producing reports on validity and reliability studies; organizing and improving test data reporting and analysis to track rater reliability, testing trends, and vendor performance; interpreting data for non-technical and senior audiences; assessing needs to update test procedures and drafting related policies and guidelines; supporting QA initiatives across LS-wide testing and assessment programs.
Required Qualifications
- Three years’ experience analyzing language testing data as a primary duty (more than 50% of the time)
- Post baccalaureate degree with significant quantitative focus in fields such as language testing, second language acquisition, educational measurement, evaluation, psychometrics, or applied linguistics
- Experience designing and conducting research studies, e.g., validity and reliability studies of language proficiency tests
- Experience using data analysis software applications (e.g., SPSS, Stata, R, WINSTEPS, FACETS, Tableau) to create, organize, and analyze large data files
- Experience using data analysis concepts, principles, and practices to conduct data collection, reviews, and reporting of information during organizational studies
- Experience designing and implementing quantitative and qualitative data collection instruments (surveys, interviews, focus groups, observations, site visits, case studies, document reviews)
- Strong ability to work in a diverse, multicultural team environment on high-priority initiatives
- Strong critical and creative thinking and analytical skills
- Strong written and oral communication skills
- High level of initiative and ability to work independently
- Authorized to work in the United States on a full-time basis and US Citizenship
- Kent, Campa and Kate Incorporated (KCK) is an equal opportunity employer; non-discrimination policy
Additional Requirements
- Must currently be authorized to work in the United States and possess US Citizenship
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.