Staff ML Engineer (ML/AI)
$161,000–$221,500 year
On-siteNew York, United States
Job Summary
Design and execute the long-term roadmap for Lyra's machine learning and generative AI platform, enabling fast, safe, and reliable deployment of frontier models. Architect end-to-end training, fine-tuning, and low-latency inference platforms, including centralized RAG architecture, vector databases, and enterprise evaluation/guardrail frameworks. Establish organizational standards for the full AI/ML SDLC—from dataset lineage and CI/CD pipelines to automated model evaluation, red-teaming, and production monitoring. Partner closely with Product Management, Data Science, Security, and Clinical leaders to translate strategic clinical goals into foundational AI capability roadmaps. Elevate the engineering culture by mentoring Senior ML Engineers, conducting high-leverage architectural reviews, and establishing engineering best practices across teams.
Required Qualifications
- 8+ years of experience deploying complex ML/AI solutions into mission-critical production environments
- proven track record of technical leadership
- Mastery of Python
- RESTful API design
- Protobuf
- microservices architecture
- Hands-on experience designing and deploying RAG pipelines
- fine-tuning LLMs
- managing vector databases
- building robust LLM evaluation/guardrail frameworks
- Expertise with relational databases
- low-latency key-value stores
- distributed queueing system architectures
- data pipeline orchestration
- Strong experience architecting cloud-native solutions on AWS
- Experience writing high-performance production code in Java or Kotlin
- Experience architecting AI/ML systems within highly regulated environments
- HIPAA compliance
- SOC2
- handling PHI/PII
- Experience building internal developer platforms or ML tooling used by dozens of data scientists and engineers
Desired Qualifications
- Celery
- Kafka
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.