Senior AI Engineer
$210,000–$270,000 year
HybridSan Francisco, California, United States
Job Summary
Train and fine-tune open-source foundation models using proprietary healthcare datasets to automate clinical documentation. Build evaluation frameworks, benchmarks, and monitoring systems that continuously improve model quality tied to real-world clinical outcomes. Design metrics, feedback loops, and accuracy measurement systems while developing agentic AI workflows that clinicians rely on daily. Construct scalable, cost-efficient inference infrastructure for production AI systems and improve model accuracy, latency, reliability, and observability. Partner closely with founders on AI strategy, prototype new capabilities, and establish the long-term roadmap. Lead the AI team and mentor engineers as the first dedicated AI hire at a Series A healthcare AI startup.
Required Qualifications
- 7+ years of software engineering experience with significant AI/ML depth
- Experience training or fine-tuning open-source LLMs in production environments
- Experience building production AI systems rather than research-only projects
- Experience at Seed to Series B startups
- Experience designing evaluation frameworks and model monitoring systems
- Demonstrated ownership of AI products from experimentation through deployment
- Strong Python engineering skills
- Experience fine-tuning open-source models such as LLaMA, Mistral, or similar
- Deep understanding of model evaluation and benchmarking methodologies
- Experience with LoRA, PEFT, Hugging Face, or related fine-tuning frameworks
- Experience building inference infrastructure and model-serving systems
- Experience with agentic systems, orchestration, and tool usage frameworks
- Experience with monitoring, observability, and production AI operations
- Familiarity with vector databases, retrieval systems, and RAG architectures
- Strong system design and architecture fundamentals
- Degree in Computer Science, Machine Learning, AI, or related technical field
Desired Qualifications
- Founding Engineer or early AI hire experience preferred
- Healthcare AI experience strongly preferred
- Experience building systems used by real customers in high-accuracy environments
- Graduate degree (MS or PhD) in AI, NLP, ML, or related field strongly preferred
- High ownership mentality
- Strong communication and collaboration skills
- Ability to operate independently
- Comfortable working in ambiguity
- Strong product judgment
- Startup mindset and bias toward execution
- Passion for healthcare impact
- Healthcare AI startups
- Clinical documentation AI companies
- Voice AI and healthcare NLP platforms
- Early-stage venture-backed startups
- Founding AI Engineer backgrounds
- Teams deploying production LLM systems
- Organizations focused on model evaluation and accuracy
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.