Senior Solutions Architect, GPU Cloud GenAI – Infrastructure
On-site · Mumbai, Maharashtra, India
Job Summary
Design and build GPU cloud platforms (IaaS, PaaS, SaaS) for large-scale GPU clusters (32+ HGX/DGX nodes) and enable enterprise AI workloads. Architect scalable infrastructure across compute, networking, and storage; develop production-grade APIs, control planes, and multi-tenant services; implement Kubernetes (GPU operators, device plugins) and Slurm orchestration for high performance computing. Define resource scheduling, isolation, quota management, and observability to ensure secure multi-tenant deployments. Advise customers on deploying and scaling generative AI workloads (LLMs, MLLMs, RAG pipelines) across on-premises and hybrid cloud environments, translating AI requirements into infrastructure specifications. Engage with C-level executives and infrastructure teams to drive platform adoption, resolve deep infrastructure issues, and influence product roadmap. Collaborate with NVIDIA engineering teams to improve capabilities and optimize GPU clusters for cost efficiency and throughput. Partner with customer teams to tune, scale, and optimize GPU environments for enterprise-scale workloads.
Required Qualifications
- Bachelor's degree in Computer Science, Computer Engineering, or equivalent experience
- 5+ years of hands-on infrastructure or platform engineering experience with large-scale GPU clusters (100+ nodes)
- Deep expertise building IaaS, PaaS, and SaaS platform layers—architecting and developing infrastructure foundations
- Proficiency in Kubernetes and Slurm for HPC/AI workloads
- Hands-on experience with Terraform, Helm, Ansible, CI/CD, and observability stacks (Prometheus, Grafana)
- Strong coding ability in Python and/or Go/C++, building platform tooling and automation
- Experience with cloud-native networking (InfiniBand, RoCE, RDMA) and distributed storage for GPU environments
- Excellent communication skills with both engineers and C-level stakeholders
- Bachelor's degree or equivalent experience - listed above (redundant for clarity)
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.