SR Principal Software Engineer - LLM Engineering
On-site · Palo Alto, California, United States
Job Summary
Senior Principal Software Engineer at JPMorgan Chase leading AI/ML model serving strategy and execution. Defines and implements MLOps/LLMOps for end-to-end model lifecycle across cloud and on-prem environments, focusing on high-throughput, low-latency inference with technologies like Triton and vLLM. Builds durable ML engineering frameworks, enforces CI/CD and infrastructure-as-code, and partners with data science, platform engineering, and SRE to productionize models on AWS with observability, reliability, and cost efficiency. Drives adoption of best practices in automation, monitoring, security, and governance while communicating effectively with executive and product leadership to deliver scalable AI/ML capabilities that meet business outcomes.
Required Qualifications
- Formal training or certification on software engineering concepts
- 10+ years of applied software engineering experience
- 8+ years AI/ML engineering experience with LLMs and GNNs
- Experience deploying LLM/GNN solutions on AWS (SageMaker, Bedrock, EKS) at enterprise scale
- Hands-on experience with Triton Inference Server and vLLM
- Proficiency in Python; PyTorch; TensorFlow; Hugging Face Transformers
- Experience with ML tooling (MLflow, SageMaker Pipelines, Kubeflow) and CI/CD
- Strong communication and cross-functional collaboration skills
- Proven ability to translate complex technical concepts for leadership
- Security/compliance awareness for AI/ML deployments
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.