AI Quality Analyst
$122,800–$184,200 year
On-siteLincolnshire, Illinois, United States
Job Summary
AI Quality Analyst at Zebra responsible for evaluating the performance, safety, and reliability of AI/ML models. Design, develop, and maintain a comprehensive evaluation strategy with benchmarks; identify edge cases, adversarial inputs, and biases; perform error analysis and triage defects; source and curate data for evaluation; conduct red-teaming exercises; manage testing environments; translate results into actionable reports; contribute to process improvements of testing methodologies and tools; collaborate with development teams to drive model improvements and communicate findings to both technical and non-technical stakeholders.
Required Qualifications
- Proven experience in a quality assurance, testing, or data analysis role, preferably within the AI/ML domain.
- A deep understanding of the machine learning lifecycle and the common failure modes of AI models.
- Hands-on experience with data annotation, data validation, and managing large datasets.
- Meticulous attention to detail and a methodical approach to problem-solving.
- Strong analytical skills with the ability to identify patterns in data and draw meaningful conclusions.
- Expertise with industry-standard test automation tools and libraries (e.g., Selenium, Playwright, Cypress, REST-assured).
- Experience in testing across different platforms (mobile Android/iOS and web applications).
- Experience with bug tracking systems (e.g., Jira) and test case management tools.
- Scripting skills (e.g., Python) for test automation and data manipulation.
- Excellent communication skills, with the ability to clearly document bugs and articulate complex technical issues.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.