Senior Python Backend Developer / ML Engineer
Remote
Job Summary
Design and build scalable backend systems, APIs, and microservices with FastAPI using Python, SQL, async/await, and SOLID design principles. Integrate Azure OpenAI with robust retry and error handling while orchestrating async workflows using Celery for complex pipelines. Implement LLM observability with Langfuse to track prompts, tokens, cost, and latency, alongside multi-tenant architectures ensuring strict data isolation. Develop prompt management with versioning and fallbacks, integrate third-party APIs for document understanding and OCR, and troubleshoot systems using structured logging and distributed tracing. Document all APIs and changes using OpenAPI/Swagger.
Required Qualifications
- Bachelor's or Master's degree in Computer Science or a related field
- Strong Python coding skills - 7+ years
- 2+ years of hands-on experience with machine learning and production LLM systems
- Experience building backend APIs with FastAPI, async patterns, rate limiting, and SQLAlchemy - 3+ years
- Experience designing maintainable and extensible systems using dependency injection, interfaces, and abstract base classes
- Experience with vector databases such as Pinecone, Weaviate, or Chroma, as well as hybrid search
- Strong understanding of RAG architectures, including retrieval, reranking, context assembly, and response generation
- Hands-on experience with LangChain and LangGraph for building and orchestrating LLM workflows
- Advanced Python skills, including async/await, type hints, Pydantic, and SOLID principles
- MLOps experience with MLflow, model versioning, and A/B testing
- Experience in NLP and computer vision, including document understanding, OCR, and GPT-4 Vision
- Experience building feature pipelines, real-time and batch inference systems, and model serving
- Hands-on experience with Hugging Face
- Experience in designing on cloud platform including: Azure (strongly preferred): Azure OpenAI, Blob Storage, Key Vault, Container Registry, AWS or GCP
- Experience in data engineering in Big Data systems including: Large-scale data processing, ETL/ELT pipelines
Desired Qualifications
- experience with Langfuse
- Understanding of DevOps, CI / CD including: Docker containerization, Azure DevOps pipelines or GitHub Actions, Kubernetes
- Data security including: Multi-tenant data isolation, Secure key management (Azure Key Vault), Audit trail implementation
- experience with LlamaIndex
- Azure (strongly preferred)
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.