Routine Labs logo
Routine Labs5 months ago

Senior Software Engineer (Backend/LLM Infrastructure)

On-site · Berlin, State of Berlin, Germany

Type
Full Time
Level
Mid Level
Education
Not Specified
Company size
Unknown

Job Summary

Senior Software Engineer (Backend/LLM Infrastructure) responsible for building and operating backend services and LLM pipelines to make automation fast, reliable, and production-ready. Responsibilities include developing Python/FastAPI services, SQLAlchemy models, Redis caching, and background jobs; orchestrating LLM pipelines with RAG flows and agent workflows; owning CI/CD pipelines, environment promotion, schema migrations, and canary/blue-green deployments; adding observability with OpenTelemetry; implementing secure multi-tenant access with SSO (OIDC/SAML) and RBAC; and participating in on-call rotations and incident response.

Required Qualifications

  • 4–6+ years of backend or full-stack engineering experience with Python/FastAPI/LangGraph in production
  • Hands-on experience with LLM systems, embeddings, vector stores, and performance/cost optimization
  • Strong CI/CD and operations mindset: SLOs, monitoring, incidents, and rollbacks
  • Solid SQL, Redis, and background job experience
  • Experience integrating SSO (OIDC/SAML) and multi-tenant RBAC
Sorce

Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.

Hiring someone like this?

Get your role in front of qualified candidates on Sorce.

Get started

Routine Labs

Senior Software Engineer (Backend/LLM Infrastructure)

Apply on Sorce