Backend Engineer (Node.js/NestJS) — Tbilisi, Georgia
RemoteUnited States or Tbilisi, Tbilisi, Georgia
Job Summary
Build and maintain a Node.js-based proxy backend that accepts inference requests, schedules and serializes prompts, and manages QKV cache load/unload. Extend the existing dashboard with dataset upload, training job views, and adapter selection while reusing Auth0, Stripe, and user management code. Integrate with authentication, RBAC, and logging stacks; expose metrics and logs for monitoring inference usage and performance. Develop using NestJS, PostgreSQL, Redis, and HashiCorp Vault, leveraging Socket.IO for real-time updates on job status and inference progress. Collaborate with C++/CUDA engineers and DevOps teams on deployment pipelines involving Proxmox and Docker.
Required Qualifications
- Strong experience with Node.js and NestJS framework
- Proficiency in PostgreSQL and Redis for persistence and caching
- Hands-on experience with Socket.IO or other WebSocket libraries
- Experience with secure configuration and secrets management (HashiCorp Vault preferred)
- Comfortable working with microservices and integrating with existing codebases
- Strong debugging and systems thinking — able to reason about scheduling, state management, and concurrency
- Familiarity with LangChain for building AI-powered features and workflows
Desired Qualifications
- Experience integrating with AI runtimes (gRPC/REST backends for inference)
- Experience with RAG and MCP
- Experience with authentication/authorization frameworks (Auth0, JWT, RBAC)
- Familiarity with Stripe API or similar billing systems
- Contributions to backend open-source projects
- Experience with WebRTC
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.