Senior AI Engineer (LLM & Agent Systems) — Platform
$200,000–$400,000 year
HybridNew York City, New York, United States or New York, United States
Job Summary
Design and implement orchestration patterns for LLM-powered agents to accelerate delivery across multiple projects. Build shared APIs and reusable platform components that enable internal teams to rapidly develop and deploy intelligent systems. Define evaluation standards and maintain testing frameworks to ensure consistent model performance, accuracy, and latency. Evaluate and select models, tools, and providers based on performance, cost, and reliability while implementing safeguards and fallback mechanisms. Collaborate with platform and backend engineers to integrate AI capabilities into scalable services, prioritizing measurable quality through structured evaluation and observability.
Required Qualifications
- Strong background in building production-grade distributed systems or platform infrastructure
- Practical experience developing and deploying LLM-based or agent-driven systems
- Demonstrated ability to design for reliability, observability, and cost efficiency
- High standards for code quality and system design
Desired Qualifications
- Familiarity with retrieval systems, embeddings, or context management pipelines
- Experience working within regulated or security-conscious environments
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.