Senior Developer Technology Engineer - Edge Agentic AI
$152,000–$241,500 year
On-siteSanta Clara, California, United States
Job Summary
Conduct end-to-end agentic AI GPU deployment on NVIDIA RTX and DGX platforms by collaborating with internal engineering teams, external app developers, and enterprise ISVs. Apply profiling and debugging tools to analyze demanding accelerated workflows, detect insufficient system utilization, and optimize runtime performance. Lead technical sessions, develop sample code, and host presentations to guide efficient deployment targeting optimal performance. Enhance LLM and GenAI user experiences through feature and performance improvements of open-source software such as GGML, Llama.cpp, Ollama, and vLLM. Provide technical leadership and mentorship to junior engineers while collaborating with GPU driver and architecture teams to influence next-generation features based on real-world workflows and partner needs.
Required Qualifications
- 5+ years of professional experience in local GPU deployment, profiling and optimization
- Bachelor's or Master's degree or equivalent experience in Computer Science, Engineering, or a related field
- Strong proficiency in C/C++, Python, software design, programming techniques
- Familiarity with and development experience on Windows and Linux
- Experience with CUDA and NVIDIA's Nsight GPU profiling and debugging suite
- Some travel is required for conferences and for on-site visits with external partners
- Strong problem-solving skills and the ability to work both independently and collaboratively in a fast-paced environment
- Excellent interpersonal and communication skills and a passion for keeping track with the latest advancements in AI technology
Desired Qualifications
- Experience with GPU-accelerated AI inference driven by NVIDIA APIs and SDKs, specifically TensorRT-RTX, cuDNN, NVIDIA Model Optimizer
- Expertise with professional agentic AI use cases, i.e., digital content creation and productivity workflows
- Experience working with open-source LLM and GenAI software
- Detailed knowledge of the latest generation GPU architectures
- Experience with AI deployment on NPUs and ARM architectures
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.