Distinguished AI Engineer
$350,000–$600,000 year
Hybrid · New York City, New York, United States
Job Summary
Lead the design, development, and deployment of agentic AI systems across Charlie Health's platform. Own technical strategy and production deployment for agentic AI, clinical operations agents (scheduling, intake, insurance verification, referral triage, care coordination), and clinician copilots for real-time documentation and risk surfacing. Define the agentic substrate with eval frameworks, observability, guardrails, tool registries, prompt and policy versioning, PHI-safe logging, and simulation environments. Manage model strategy across frontier models, fine-tunes, and traditional ML, and collaborate with Product, Clinical, and Data teams to identify high-leverage AI opportunities. Establish best practices around AI reliability, safety, evaluation, and explainability in a regulated clinical environment. Mentor engineers and data scientists, and work within a modern data foundation (Snowflake, dbt, pgvector) to support a national virtual IOP serving patients across 41 states. This is a hands-on technical leadership role with a hybrid NYC-office schedule.
Required Qualifications
- 10+ years of software engineering experience, with several recent years focused on LLM- or ML-powered systems in production
- Hands-on experience designing and operating agentic systems, including tool use, planning, multi-agent orchestration, eval design, and failure-mode analysis
- Track record of owning a complex technical initiative end-to-end, including evaluation infrastructure, observability, on-call, and regulatory or compliance review
- Strong communication skills and comfort operating across registers, from executive strategy conversations to engineering code review
- Genuine interest in healthcare and in applying AI responsibly in a regulated, high-stakes domain
- BS, MS, or PhD in Computer Science, Machine Learning, Engineering, Mathematics, or a related technical field, or equivalent practical experience
- Able to work a hybrid schedule of 4 days/week in our NYC office and located within 75 minutes' commuting distance of the office
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.