Application Manager - AI Solution
On-siteShanghai, Shanghai, China
Job Summary
Lead the design, development, and deployment of GenAI solutions using Java and Python. Own the enterprise LLM model layer, including model selection, deployment, fine-tuning, evaluation, and lifecycle management. Design and build secure LLM proxy/API gateway services with guardrails for security, compliance, content filtering, privacy protection, and usage monitoring. Develop and maintain LLM evaluation and testing harnesses to benchmark model performance, accuracy, safety, latency, and cost. Establish automated testing and regression frameworks for prompts, RAG applications, and AI agents. Collaborate with Information Security, Compliance, and Governance teams to ensure AI solutions meet enterprise standards and regulatory requirements. Partner with business stakeholders and vendors to discover use cases, define requirements, and deliver high-quality AI solutions. Mentor engineers and promote best practices in GenAI, software engineering, and platform development. Stay current with emerging AI technologies, LLM platforms, and GenAI engineering practices.
Required Qualifications
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience
- 7+ years of extensive hands-on experience in software development, with a strong emphasis on both Java and Python
- Proven expertise in Java development, with a strong understanding of Java ecosystems and frameworks (e.g., Spring Boot)
- Demonstrable experience in LLM deployment and model fine-tuning
- Experience in building API proxy layers, with an understanding of security policies like OAuth 2.0 and JWT validation
- Familiarity with information security best practices and compliance and governance policies in software development
- Strong problem-solving, analytical, and design thinking skills
- Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams, vendors, and users
- Experience working in Agile development environments
Desired Qualifications
- Strong experience in microservices architecture and development
- Experience with OpenAI, Anthropic, Qwen, or other foundation models
- Familiarity with LangChain, LangGraph, or similar GenAI frameworks
- Experience with RAG, agent-based architectures, vector databases, and AI observability
- Knowledge of Kubernetes/OpenShift, Docker, and cloud-native application development
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.