(Senior) Software Engineer - AI/ML (m/f/d)
HybridBengaluru, Karnataka, India
Job Summary
Design, build, and operate backend services and APIs that power AI-driven and traditional product capabilities using Java and Python. Integrate LLMs, AI agents, and retrieval-based solutions into production applications while developing high-quality software focused on reliability and performance. Own services end-to-end, from architecture through deployment, monitoring, and operations, contributing to CI/CD pipelines and engineering best practices. Troubleshoot complex production issues and ensure systems remain scalable, secure, and observable. Work closely with AI Engineers and Cloud Operations teams to deliver capabilities on the Cognitive Backend platform. This role is located in Bangalore (Whitefield, ITPL) within a hybrid model requiring 50% office attendance for the first six months. Candidates must have strong backend experience with Java and practical exposure to AI-powered applications.
Required Qualifications
- Strong experience building backend applications with Java
- Strong experience designing, building, and operating APIs, services, and distributed systems in production environments
- Proficient Python skills for automation, integrations, and AI-related development
- Hands-on experience with cloud platforms such as Azure, AWS, or GCP
- Experience with modern CI/CD practices
- Experience with containerized applications using Docker
- Strong understanding of monitoring, logging, and observability
- Practical experience building, integrating, deploying, or operating AI-powered applications
- Experience with LLM-based solutions
- Experience with retrieval systems
- Experience with agentic frameworks
- Experience operating AI-powered applications in a professional environment
Desired Qualifications
- Experience with frameworks such as LangChain, LangGraph, CrewAI, or similar technologies for building AI-powered applications
- Familiarity with vector databases such as Pinecone, Weaviate, Milvus, Chroma, or pgvector
- Experience working with Retrieval-Augmented Generation (RAG) architectures
- Experience with AI evaluation frameworks such as Ragas, Promptfoo, or similar tools
- Hands-on experience with Kubernetes, ideally within Azure Kubernetes Service (AKS) environments
- Experience with Infrastructure as Code using Terraform or similar technologies
- Experience building multi-tenant SaaS platforms
- Experience building enterprise software products
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.