Machine Learning Engineer, AI Labs
On-siteTaipei, Taiwan, Taiwan
Job Summary
Collaborate on the AI roadmap by driving execution of critical AI/ML technical strategies and building highly scalable, production-grade systems. Architect high-performance inference systems by designing, optimizing, and deploying enterprise-scale LLM serving infrastructures that push boundaries of throughput and latency. Own the end-to-end AI lifecycle by partnering with ML scientists to translate business requirements into deployed code and enforce excellence through strict model "Report Cards" tracking accuracy, latency, and security relevance. Work alongside senior architects and researchers to solve industry challenges in cloud security, utilizing frameworks like vLLM and SGLang for inference optimization.
Required Qualifications
- 10+ years of overall experience in software engineering and product development
- 2+ years of production experience developing, optimizing, and deploying AI/ML solutions
- 6+ years of deep experience architecting, building, and scaling high-performance distributed systems
- BSCS or equivalent
- Strong conceptual understanding of optimizing LLMs in production
- Familiarity with high-throughput inference frameworks (e.g., vLLM, SGLang, TensorRT-LLM)
- Knowledge of memory management techniques like KV Cache optimization
- The ability to distill complex technical architecture or infrastructure bottlenecks into clear, actionable concepts for cross-functional teams
- You are an energetic self-starter who thrives in fast-paced, dynamic environments and isn't afraid to wear multiple hats to get a product across the finish line
Desired Qualifications
- An advanced technical degree
- Hands-on experience in AI/ML
- Direct exposure to (or a strong conceptual understanding of) optimizing LLMs in production
- Familiarity with high-throughput inference frameworks (e.g., vLLM, SGLang, TensorRT-LLM)
- Knowledge of memory management techniques like KV Cache optimization
- MSCS or equivalent
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.