Software Engineer, AI Platform
$188,000–$254,000 year
HybridSan Francisco, California, United States
Job Summary
Design and develop core backend services, APIs, and microservices that enable product teams to securely leverage AI models. Build scalable frameworks supporting multi-step agent workflows, including task decomposition, tool invocation, and persistent memory. Construct robust evaluation systems to measure reasoning quality, hallucination rates, and task success. Architect high-performance serving infrastructure with strict guarantees around latency, throughput, cost-efficiency, and error handling. Ensure comprehensive monitoring, structured logging, and distributed tracing across all deployed AI models. Partner with designers, product managers, and engineers to build self-serve infrastructure that transforms the AI development cycle. Advocate for software engineering best practices, conduct thorough design and code reviews, and mentor junior engineers.
Required Qualifications
- Bachelor's degree in Computer Science, Mathematics, a related field, or equivalent practical experience
- 2+ years of professional software engineering experience
- Strong full-stack fundamentals: you're comfortable working across frontend, backend, and data layers
- Excellent debugging and technical investigation skills
- Strong technical communication, ideally with experience collaborating in an asynchronous remote environment
- Ability to move fast and iterate in ambiguous environments: you take ownership and focus on delivering value to users
- Hands on experience integrating and orchestrating LLMs and agents
- Experience building AI native systems, including iteratively improving and scaling them in production
- Familiarity with techniques used to optimize AI agents: eval frameworks, agent tooling, vector search engines, context engineering, and prompt engineering
Desired Qualifications
- A desire to be on the forefront of leveraging AI to drive product improvement, observability and product analytics at scale
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.