Senior AI Software Development Engineer
HybridBengaluru, Karnataka, India or Hyderabad, Telangana, India
Job Summary
Build and optimize enterprise-grade agent orchestration frameworks supporting tool use, memory, RAG, and multi-agent collaboration. Integrate Gemini models via Vertex AI, developing internal SDKs and reusable components to standardize usage across F5 teams. Develop reference implementations and libraries for high-code agents in Java, Python, Go, or TypeScript, enabling secure integrations with Salesforce, Snowflake, and ServiceNow. Establish logging, tracing, and evaluation pipelines for agent performance while applying safety guardrails, input validation, and policy enforcement. Optimize inference latency, parallelization, and cost management strategies across agent workflows. Guide engineering teams in adopting Gemini Code Assist and internal AI platforms through code reviews and technical documentation.
Required Qualifications
- 7+ years of experience in software engineering
- strong experience in distributed systems
- strong experience in backend architecture
- Deep hands-on coding expertise in Python
- at least one of: Go, Java, or TypeScript
- Hands-on production experience with LLM-based systems
- prompt engineering
- tool calling
- RAG
- embeddings
- agent frameworks
- Experience with Vertex AI
- Gemini APIs
- OpenAI APIs
- similar enterprise AI platforms
- Strong understanding of API design
- microservices
- cloud-native architectures
- Docker
- Kubernetes
- Experience building or integrating orchestration frameworks
- LangChain
- LlamaIndex
- custom orchestration layers
- Familiarity with vector databases
- embedding pipelines
- retrieval strategies
- Strong understanding of authentication
- authorization
- enterprise security patterns
- Proven ability to build robust, reusable code
- clean APIs
- Hybrid: Employees within 30 commutable miles of an F5 office are required to work from the office a minimum of 30 business days per quarter
Desired Qualifications
- Experience building multi-agent systems
- autonomous workflow engines
- Experience with model evaluation pipelines
- AI quality metrics
- Familiarity with structured output enforcement
- JSON schemas
- function calling
- Experience working with enterprise data systems such as Snowflake
- Salesforce
- ServiceNow
- SharePoint
- Knowledge of cost modeling
- inference optimization techniques
- Experience contributing to internal developer platforms
- SDK ecosystems
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.