Senior Software Engineer (Python, GenAI)
On-site · US
Job Summary
Senior Backend Engineer to design and implement a Retrieval-Augmented Generation (RAG) backend platform powering secure search and AI-powered Q&A across enterprise email and documents. Responsibilities include building FastAPI services for search and AIQ&A, implementing hybrid retrieval (semantic + keyword) using Azure AI Search, integrating LLM services to generate grounded responses with citations, returning structured API responses with diagnostics, enabling filter-based search, and implementing Entra ID authentication and group-based authorization. You will deploy and operate services on AKS with Docker and Kubernetes, implement observability (logging, metrics, tracing), align document chunk schemas with data engineers, monitor index freshness and system reliability, and collaborate with frontend engineers. Required skills include strong Python with FastAPI, REST/microservices, vector search, LLM integration, OAuth2/OIDC/Entra ID, Docker, Kubernetes, Azure cloud services, CI/CD, and a solid grasp of scalable architectures; advantageous experience includes ACL-aware search, document processing pipelines, and citation-based AI systems.
Required Qualifications
- 5+ years backend engineering experience
- Strong Python experience with FastAPI or similar frameworks
- Experience building REST APIs and microservices
- Experience with vector search or hybrid retrieval systems
- Experience integrating LLMs into production applications (RAG or similar)
- Knowledge of authentication and authorization patterns (OAuth2, OIDC, Entra ID)
- Hands-on experience with Docker and Kubernetes
- Experience working with Azure cloud services
- Strong understanding of software design principles and scalable architectures
- Experience with CI/CD pipelines and Git-based workflows
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.