Senior Engineer 2: Inference Data Plane
$167,200–$209,000 year
Remote · Seattle, Washington, United States or US
Job Summary
Join DigitalOcean as a Senior Engineer 2 to lead the design, development, and delivery of data plane components for AI inference services. The role involves system design for high-scale cloud ecosystems, optimizing performance for large generative AI models, collaboration across departments, and mentoring junior engineers. Required skills include expertise in distributed systems and AI/ML, familiarity with specific inference frameworks and GPU optimization, as well as proficiency in GoLang or Python. This is a hands-on role focusing on delivering high-quality software and operational excellence.
Required Qualifications
- Strong experience with microservices
- Experience with messaging systems and databases
- Proven experience shipping customer-facing software products
- Understanding of GPU-level optimization and interconnect technologies
- Knowledge of common LLM architectures and optimization techniques
- Familiarity with distributed inference serving frameworks
Desired Qualifications
- Expert-level proficiency in GoLang or Python
- Familiarity with gRPC
- Experience building with open-source software
- Hands-on experience hosting large language or multimodal models using inference engines
Additional Requirements
- Application Limit: You may apply to a maximum of 3 positions within any 180-day period.
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.