AI/ML Engineer
$86,800–$198,000 year
On-site · Arlington, Virginia, United States or O'Fallon, Illinois, United States
Job Summary
AI/ML Engineer role focused on designing, creating, and implementing complete AI systems for the Defense and Intelligence sectors. Responsibilities include building production-grade ML solutions (including LLMs, agents, and complex automation), deploying models across multiple modalities in cloud environments (AWS/Azure), and integrating ML models with tools and frameworks (Docker, Kubernetes, LangChain, LangGraph, PydanticAI, llamaindex). You will evaluate LLM performance, design observation layers for stakeholders (Grafana, Langfuse, LangSmith, Phoenix), and help ensure scalable, service-based software architectures. The role emphasizes rapid deployment, collaboration with cross-functional teams, and expanding capabilities in MLOps, software deployment, and integration into mission environments. Security clearance (Secret) is referenced as part of eligibility, and there is a note about compensation structure and benefits within Booz Allen. The position also discusses remote/work model flexibility and identity/privacy processes as part of the hiring workflow.
Required Qualifications
- 3+ years of experience as a ML engineer
- 3+ years in data science or data research
- 3+ years in cloud environments (AWS and Azure)
- 2+ years deploying production-grade ML models using Docker and Kubernetes
- Experience with LLMs, DL, and RL and AI agent frameworks (e.g., LangChain, LangGraph, PydanticAI, llamaindex)
- Experience connecting agents to APIs/cloud platforms/databases
- Experience evaluating LLM performance and building observation layers (e.g., Grafana, Langfuse, LangSmith, Phoenix)
- Ability to evaluate architectural tradeoffs and design scalable service-based software
- Bachelor’s degree
- Ability to obtain Secret clearance
- Nice-to-have: TensorFlow, PyTorch, Kafka/Confluent/Red Panda
- Experience with client engagements and business development
- Strong communication and organizational skills
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.