AI Software Engineer - HP IQ
$127,000–$175,000 year
On-siteSan Francisco, California, United States
Job Summary
Design and maintain high-performance, scalable services powering AI-driven applications across edge and cloud environments. Develop APIs and microservices facilitating seamless integration between cloud-based AI models and edge devices, while optimizing data pipelines for real-time inference. Build and optimize an agent orchestration runtime enabling tool use, memory management, and multi-step reasoning across LLMs and edge-connected systems. Collaborate with researchers and infrastructure engineers to implement security and privacy best practices for distributed AI. Requires a Master's degree and 1+ years of backend development in Python, Java, and C++. Full-time role in the United States.
Required Qualifications
- Masters in Computer Science, Engineering, Data Science, Artificial Intelligence or related fields
- 1+ years of experience in backend software development
- strong proficiency in Python, Java, and C++
- Working knowledge in LLM integration into multi-agent systems
- strong understanding of agent orchestration, tool use, and memory/context management
- Comfortable tinkering with LLMs via prompting
- experienced with tools use, task decomposition, and structured outputs
- Familiarity with database management systems (SQL and NoSQL)
- Familiarity with data streaming technologies
- Strong problem-solving skills
- ability to work in a fast-paced, agile environment
Desired Qualifications
- Experience with AI model deployment and integration into backend services
- Exposure to cloud-edge hybrid architectures and distributed AI workloads
- Familiarity with on-device AI frameworks such as PyTorch, TensorFlow Lite, ONNX Runtime, or CoreML
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.