Inference Systems Performance Architect
$245,000–$325,000 year
On-siteSan Jose, California, United States
Job Summary
Define and drive the technical strategy for inference-systems performance, including workload capture, benchmarking, modeling, and simulation. Build the workload-capture and agentic-benchmarking capability to represent real production traffic, while owning the performance-modeling practice to predict configuration changes against customer SLOs. Attack the end-to-end profiling gap by developing tooling that localizes bottlenecks across host, accelerator, and fabric. Serve as the senior technical voice across model-optimization, systems, hardware, and product teams, mentoring senior engineers and resolving ambiguous, novel challenges that span organizational boundaries.
Required Qualifications
- 12+ years of experience in performance engineering, with a demonstrated record of technical leadership on large-scale, complex systems
- Deep expertise in end-to-end performance analysis of distributed systems with many moving parts and the ability to localize bottlenecks that others cannot
- Proven command of realistic workload generation and simulation and of performance modeling, including calibrating models against real, variable workloads
- Demonstrated ability to enter an unfamiliar domain and apply core performance methods with transferable discipline expertise
- Ability to lead cross-functional efforts, mentor senior engineers, and influence organizational direction
- Experience representing an organizations credibly to customers and partners
- Track record of independently scoping and delivering high-complexity, high-ambiguity work with significant impact on products or roadmap
Desired Qualifications
- Direct experience with LLM inference serving - continuous batching, prompt/KV caching, prefill/decode disaggregation, tail-latency SLOs
- Familiarity with inference simulation frameworks or agentic benchmarking efforts
- A public technical voice - talks, writing, or community presence on systems performance
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.