Software Engineer III - AI/ML Deep Learning & GPU ML Serving
On-site · Palo Alto, California, United States
Job Summary
Software Engineer III on JPMorgan Chase's Commercial and Investment Banking team. Develop, test, and troubleshoot software solutions; write secure, high-quality production code and integrate algorithms with firm systems. Produce architecture and design artifacts for complex applications; analyze and visualize large, diverse data sets to improve applications and systems. Identify hidden issues in data to enhance code quality and system architecture; collaborate with software engineering communities to adopt new technologies. Participate in system design discussions focusing on reliability and scalability. Optimize deep learning models for production inference (quantization and batching) and deploy/manage GPU workloads in Kubernetes. Build scalable, low-latency systems using web services and APIs and partner with product/program management to deliver business-driven solutions. Target skills include Python, TensorFlow/PyTorch, Docker/Kubernetes/EKS, AWS/GCP, TorchServe/TF Serving/Triton, Cassandra NoSQL, microservices, GPU resource management, and ML/observability practices.
Required Qualifications
- Formal training or certification on software engineering concepts and 3+ years applied experience
- Professional software development experience, with emphasis on ML systems
- Strong proficiency in Python and experience with ML frameworks (TensorFlow, PyTorch, or similar)
- Experience with cloud technologies (Docker, Kubernetes, EKS) and public clouds (AWS, GCP)
- Hands-on experience with ML model serving frameworks (TorchServe, TensorFlow Serving, Triton Inference Server)
- Experience deploying and managing GPU workloads in Kubernetes
- Familiarity with scalable, low-latency systems based on web services and APIs
- Experience with NoSQL databases (Cassandra or equivalent) for high-throughput data access
- Understanding of GPU resource management and cost optimization
- Experience with modern microservices architecture
- Ability to lead the design of large-scale systems and evaluate tradeoffs
Additional Requirements
- FDIC Act Section 19 employment offer contingent on review of criminal conviction history, including pretrial diversions or program entries
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.