Senior ML Engineer with Python (IR-536)
Remote
Job Summary
Build and refine scalable backend systems, APIs, and microservices using FastAPI, Python, and SQL. Implement MLOps workflows including model tracking, drift detection, and feedback loops while deploying and operationalizing LLMs and generative AI models. Integrate Azure OpenAI and other providers with proper error handling, orchestrate pipelines for feature engineering and inference, and develop prompt management systems with versioning. Ensure multi-tenant data isolation, optimize LLM costs through caching and batch processing, and write production-ready code with rigorous testing and async patterns. Collaborate with client-facing teams to gather requirements, participate in agile ceremonies, and document changes via OpenAPI standards.
Required Qualifications
- Bachelor's or Master's degree in Computer Science or a related field
- Strong Python coding skills - 7+ years
- 2+ years of hands-on experience with machine learning and production LLM systems
- Experience building backend APIs with FastAPI, async patterns, rate limiting, and SQLAlchemy - 3+ years
- Experience designing maintainable and extensible systems using dependency injection, interfaces, and abstract base classes
- Experience with vector databases such as Pinecone, Weaviate, or Chroma, as well as hybrid search
- Strong understanding of RAG architectures, including retrieval, reranking, context assembly, and response generation
- Hands-on experience with LangChain and LangGraph for building and orchestrating LLM workflows
- Advanced Python skills, including async/await, type hints, Pydantic, and SOLID principles
- MLOps experience with MLflow, model versioning, and A/B testing
- Experience in NLP and computer vision, including document understanding, OCR, and GPT-4 Vision
- Experience building feature pipelines, real-time and batch inference systems, and model serving
- Hands-on experience with Hugging Face
- Familiarity with database technologies such as SQL
- Good problem-solving skills and the ability to work in a fast-paced, team-oriented environment
Desired Qualifications
- experience with Langfuse
- Understanding of DevOps, CI / CD including: Docker containerization, Azure DevOps pipelines or GitHub Actions, Kubernetes
- Data security including: Multi-tenant data isolation, Secure key management (Azure Key Vault), Audit trail implementation
- Experience in designing on cloud platform including: Azure (strongly preferred): Azure OpenAI, Blob Storage, Key Vault, Container Registry, AWS or GCP
- Experience in data engineering in Big Data systems including: Large-scale data processing, ETL/ELT pipelines
- Rate limiting and quota management for high-throughput API usage
- Cost management and optimization for LLM usage at scale
- Document processing expertise (PDF extraction, OCR tooling)
- Production incident management and on-call experience
- Testing strategies for non-deterministic LLM outputs (e.g., golden datasets, fuzzy matching)
- Domain knowledge in regulated industries (e.g., healthcare/pharma workflows, regulatory compliance)
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.