Technical Program Manager
RemoteBoston, Massachusetts, United States
Boston, Massachusetts, United StatesRemoteFull TimeSenior LevelTECHLarge
Full TimeSenior LevelLargeTECH
Job Summary
Lead end-to-end execution of large-scale AI/ML programs, ensuring timely delivery of production-grade LLM, RAG, and Agentic AI solutions. Define program roadmaps, manage governance and risk, and drive stakeholder alignment across global teams. Partner with engineering to design scalable GenAI architectures, optimize infrastructure for GPU-based inference, and guide model fine-tuning and deployment strategies. Act as primary client contact to ensure delivery meets contractual expectations while mentoring high-performing teams. This role requires 10+ years of experience and is based in East US.
Required Qualifications
- 10+ years of experience in program or project management
- at least 5+ years leading AI/ML or data-driven initiatives
- Proven track record managing complex, multiple work-stream programs with global teams
- Strong leadership, stakeholder management, and executive communication skills
- Experience delivering enterprise-scale AI solutions with measurable business impact
- Hands-on experience with cloud platforms: GCP, AWS, or Azure
- Strong experience with LLM ecosystems (e.g., Llama, GPT, Claude, Mistral)
- Deep expertise in: RAG (Retrieval-Augmented Generation) and Agentic AI systems
- Deep expertise in Vector databases (FAISS, Pinecone, Weaviate, ChromaDB)
- Deep expertise in LLM fine-tuning techniques (LoRA, quantization, distillation)
- Familiarity with: Multi-GPU scaling, model optimization, and inference pipelines
- Familiarity with Frameworks such as LangChain, NVIDIA NeMo, Triton Inference Server
- Understanding of AI governance, ethics, explainability, and risk mitigation frameworks
- Bachelor's degree in Computer Science, Information Technology, or related field
Desired Qualifications
- MBA or advanced degree
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.