Machine Learning Engineer, Assistant Quality
$180,000–$205,000 year
HybridSan Francisco, California, United States
Job Summary
Build and improve ML and LLM-powered systems that raise the quality of Glean's AI Assistant and autonomous agents across real user workflows. Design evaluation, benchmarking, and monitoring loops to measure assistant quality, model quality, and end-to-end system performance. Develop signals, prompts, and workflows that improve reasoning, planning, personalization, and task completion. Work across RAG, semantic search, recommendation systems, post-training, and agent orchestration to materially improve product outcomes. Partner with product, design, and engineering to understand customer pain points and ship high-quality production systems quickly. Contribute to the data and ML infrastructure supporting robust experimentation and continuous model improvement. This role sits at the intersection of production machine learning, LLM-powered systems, and product engineering, focusing on shipping agentic capabilities on an open, extensible stack.
Required Qualifications
- 2+ years of industry experience in machine learning, applied AI, or software engineering with significant ML ownership
- Strong hands-on coding ability and a track record of shipping production systems, not just prototypes or research projects
- Experience in one or more of the following areas: LLM applications, NLP, search, retrieval, recommendations, evaluation frameworks, agent systems, or personalization
- Proficiency in common ML tooling and strong software engineering fundamentals in languages such as Python, Go, Java, or C++
- A pragmatic, product-minded approach
- A proactive, low-ego working style and excitement about learning quickly in a high-velocity environment
- Hybrid work arrangement (4 days a week in San Francisco office)
- Completion of a brief AI-focused exercise or discussion as part of the interview process
Desired Qualifications
- Prior Glean experience
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.