Senior Machine Learning Test Engineer United Kingdom
Remote · London, England, United Kingdom or United Kingdom
Job Summary
Senior Machine Learning QA Engineer in the United Kingdom responsible for defining ML quality strategy across data, model, and system levels; designing and maintaining model evaluation suites, metrics, and test datasets; evaluating CAD RL model outputs for geometric validity or policy stability; translating qualitative findings into measurable evaluation gates; automating ML QA workflows with Python and CI/CD; building test harnesses for ML services and APIs; mentoring teams on ML QA best practices; contributing to multi-team projects and codebases with a focus on scalable, maintainable QA systems; ensuring code quality through reviews and clear documentation.
Required Qualifications
- Bachelor’s degree in Computer Science, Engineering, or equivalent experience
- 7+ years of professional experience in software engineering or QA for ML/AI systems
- Strong programming skills in Python, with experience in test automation
- Familiarity with popular CAD environments tooling
- Proficient in Automation and UAT test suite/framework
- Experience designing QA frameworks or platforms used by multiple teams
- Excellent problem-solving skills and attention to detail
- Strong communication and collaboration skills
- Understanding of software architecture and design patterns
- Ability to work in an agile development environment
- Experience with data validation tooling (e.g., Great Expectations) or labeling workflows
- Familiarity with ML frameworks (e.g., PyTorch, TensorFlow)
- Experience with CI/CD tools and processes
- Experience with data pipelines and orchestration tools (e.g., Airflow, Metaflow)
- Familiarity with MLOps practices (model monitoring, drift, deployment checks)
- Experience with ML evaluation methods, metrics, and benchmarking
- Experience with cloud providers (e.g., AWS, Azure, Google Cloud Platform)
- Knowledge of experiment tracking tools (e.g., Comet, MLflow, Weights & Biases)
- The Ideal Candidate is proactive and capable of building QA systems from scratch
- Comfortable collaborating across global locations
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.