AI Agents Applied Research/Engineering Lead - Vice President
On-site · Brooklyn, New York, United States
Job Summary
Lead the end-to-end lifecycle of LLM-based agents: define research directions in multi-step planning, tool use, and safety; build and deploy production systems that meet latency, memory, and cost constraints; partner with Product, Engineering, Design, and Risk to bring these systems to market. Drive research and deployment of agentic AI with multi-step workflows, tool calling, and multi-agent orchestration; apply reinforcement learning and preference optimization to improve personalization and dialogue policies; scale LLM systems with caching, batching, prompt governance, and evaluation frameworks; implement privacy, safety, and security controls including PCI compliance and auditability; design rigorous experiments with strong baselines and meaningful metrics; define and track success metrics such as task completion rate, accuracy, latency, and customer satisfaction.
Required Qualifications
- Ph.D. with 1+ years or M.S. with 3+ years building and deploying AI systems in production
- Applied GenAI experience with LLMs including fine-tuning, prompt engineering, and RAG
- Experience scaling LLM systems with caching, batching, governance, and evaluation
- Strong foundation in ML, deep learning, statistical modeling, and experimental design
- Experience in Information Retrieval (indexing, ranking, retrieval) and/or recommendation systems
- Proficiency in Python and ML frameworks (PyTorch/TensorFlow, Hugging Face, scikit-learn)
- Demonstrated ability to set a technical research agenda and drive it from concept through production deployment
- Experience presenting research findings and technical strategy to senior leadership and non-technical stakeholders
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.