Senior Software Engineer, Backend (AI)
On-sitePetaling Jaya, Selangor, Malaysia
Job Summary
Manage the AI Gateway end-to-end by independently building complex backend features for provider integrations, unified API endpoints, model onboarding, and cost tracking. Design multi-provider LLM routing systems that translate OpenAI-compatible surfaces into provider-native formats with SSE streaming and automatic fallback. Build scalable Go and Python backends handling all LLM traffic, enforcing authentication, rate limiting, and tiered capacity isolation on Redis. Operate reliability layers including token-level usage logging, chargeback pipelines, and Kubernetes deployments across AWS/GCP/Azure. Champion test-driven development, mentor junior engineers, and participate in on-call rotations to manage provider capacity incidents and lead post-mortems.
Required Qualifications
- 3+ years of professional software development experience with a history of delivering successful solutions
- Proficiency in server-side programming, specifically Go (Golang) and Python
- Hands-on experience with LLMs (Large Language Models), LangChain, and LangGraph for conversational AI development
- Practical experience with cloud providers (AWS), containerization (Kubernetes), and CI/CD pipelines
- Grasp of data structures, algorithms, distributed systems, and multi-threading
- An advocate for automated testing (unit, integration) and writing concise technical documentation
- Experience with a relational database such as MySQL, PostgreSQL, or Oracle
- This role is onsite based in our Petaling Jaya, Malaysia office
- You will report to the Engineering Manager and work onsite at the Grab Office
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.