Senior Software Engineer - Experience Agents
$168,000–$221,000 year
Hybrid · Seattle, Washington, United States
Job Summary
Senior Software Engineer - Experience Agents responsible for building observability and confidence systems for AI agents, designing and implementing test coverage to ensure production readiness, and collaborating with product, science, and customer teams. You’ll write effective prompts and debug LLM graphs using LangSmith, contribute to monitoring and observability initiatives, and help translate insights into product improvements. The role requires 5+ years of software development, experience with monitoring/observability/testing at scale, full-stack capabilities, and experience with AI/ML tools or the ability to learn new technical areas quickly. The team works across backend and frontend domains to deliver measurable business impact for customers.
Required Qualifications
- 5+ years of software development experience
- Experience building or working with monitoring, observability, or testing systems at scale
- Proven ability to work across full-stack domains (backend and frontend) in a fast-moving environment
- Experience working with AI/ML tools or demonstrated ability to pick up new technical areas rapidly
Desired Qualifications
- 5+ years software development experience
- Experience building or working with monitoring, observability, or testing systems at scale
- Full-stack development experience (backend and frontend)
- Experience with AI/ML tools or rapid learning of new technical domains
- Ability to collaborate across admin, runtime, product, and science teams
- Experience writing prompts and debugging LLM graphs using tools like LangSmith
- Experience with AI agent testing, monitoring, and instrumentation
- Strong communication skills with technical and non-technical stakeholders
- On-call support experience
- Flexible, hybrid work environment with office presence in Seattle (per posting)
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.