Data science
On-sitePune, Maharashtra, India
Job Summary
Design, develop, and deploy Generative AI and Agentic AI applications while building, testing, and optimizing LLM-based systems for performance, reliability, and scalability. Implement LLM evaluation frameworks using LLM-as-a-Judge and maintain testing frameworks for agentic workflows. Use LangFuse or similar observability tools to monitor and analyze LLM performance, integrating robust monitoring mechanisms into production environments. Optimize prompts, pipelines, and AI workflows to improve model accuracy and efficiency. Work with cross-functional teams to integrate AI solutions using LLM frameworks, vector databases, and RAG-based architectures. Apply by sending your CV to careers@cliqhr.co.in.
Required Qualifications
- 8–10 years of experience in Data Science, Artificial Intelligence, or Machine Learning
- Strong hands-on experience in Generative AI (GenAI)
- Experience building Agentic AI applications
- Experience in testing and evaluating LLM-based systems
- Hands-on experience implementing LLM-as-a-Judge evaluation frameworks
- Experience with LangFuse or similar LLM observability tools
- Strong programming expertise in Python and data science workflows
- Experience working with LLM frameworks and GenAI ecosystems
- Knowledge of prompt engineering, evaluation pipelines, vector databases, and RAG architectures
- Experience building production-grade GenAI solutions
- Ability to work in Agile environments and collaborate with cross-functional teams
Desired Qualifications
- Experience with LangChain or LlamaIndex (preferred)
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.