AI LLMOps Engineering Technical Leader
$216,300–$280,800 year
On-siteSan Jose, California, United States
San Jose, California, United StatesOn-siteFull Time$216,300–$280,800 yearBachelors DegreeEnterprise
Full TimeBachelors DegreeEnterprise
Job Summary
Operationalize complex autonomous agent architectures into secure, scalable production environments by defining robust MLOps practices and foundational ML pipelines. Design telemetry monitoring tools to track token usage, control compute costs, and ensure optimal model performance while proactively resolving infrastructure challenges on GPU clusters. Guide architectural choices for LLM orchestration and inference optimization, mentoring peers to maintain reliability across hybrid cloud systems. Collaborate with design, data science, and product teams to protect the customer experience roadmap.
Required Qualifications
- Bachelors degree
- 8+ years of related experience
- Masters degree
- 6+ years of related experience
- Experience within Software Engineering and DevOps job families
- Experience operationalizing Large Language Models
- Experience utilizing LLM frameworks such as LangChain or LangSmith
- Experience in Python
- Experience in Java/J2EE
- Experience developing robust APIs using popular frameworks such as FastAPI, Flask, Spring Boot or similar
- Experience with CI/CD concepts for machine learning
- Familiarity with model tracking and MLOps frameworks such as ClearML, MLflow, Weights & Biases or similar
- Containerization utilizing Docker and Kubernetes
Desired Qualifications
- Expertise in Agentic AI with hands-on experience in AI Agent development
- Broad perspective and ability to articulate architectural design choices regarding GPU compute scaling, model latency, and AI routing
- Knowledge of AI API gateways and proxying solutions like Apache APISIX or LiteLLM
- Strong verbal and written communication skills
- Experience contributing to threat modeling, specifically identifying and mitigating risks regarding prompt injection or AI data leakage
- Proven leadership ability to facilitate knowledge-sharing sessions, lead postmortems, and mentor junior team members on technical designs
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.