Software Engineer, Gen AI Platform
$80,000–$100,000 year
Remote · San Francisco, California, United States or New York City, New York, United States
Job Summary
As an AI Platform Engineer at Abridge, you will design and build generative AI systems, focusing on runtime, orchestration, and evaluation platforms for agentic workflows powered by LLMs. Key responsibilities include developing a reliable and scalable agent runtime, building secure execution environments, creating unified interfaces for various models, and partnering with research to enhance agent capabilities. The ideal candidate has experience with agent applications, tool use, coding in Python or Java, familiarity with containers, and strong communication skills.
Required Qualifications
- Experience building agent applications with tool-calling, context engineering, or open connector integrations.
- Fluency with LLM APIs, prompting strategies, and orchestration patterns (e.g., LangChain, LlamaIndex, or custom pipelines).
- Experience with retrieval systems (e.g., semantic and lexical retrieval, vector DBs, efficient kNN), function calling, tool use, or agentic workflows.
- Strong coding skills in one or more of: Python, Java, Go. Comfortable with service design, APIs, and data models for high-throughput systems.
- Working knowledge of containers and kubernetes concepts. Familiarity with metrics, tracing, on-call rotations, and incident response practices.
- Self-motivated with a willingness to take ownership.
- Strong communication skills and ability to work collaboratively in a team environment.
Desired Qualifications
- Prior work on agent orchestration pipelines: task routing, planning, memory graphs, vector search, or browser automation.
- Experience with evaluations, preference optimization, or RL to improve LLM reliability.
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.