Applied Machine Learning Scientist II
$125,500–$154,000 year
On-siteToronto, Ontario, Canada or Montréal, Quebec, Canada
Job Summary
Develop, deploy, and maintain Predictive and Generative AI solutions for use cases including Agentic AI, LLM-based models, Pricing, and Anomaly Detection. Lead the evaluation, implementation, testing, monitoring, and ongoing lifecycle management of both internally developed and third-party AI/ML solutions. Assess vendor-provided models for capabilities, limitations, and governance implications while translating business problems into analytical frameworks. Conduct rigorous model evaluation, A/B testing, and validation to ensure performance, fairness, and compliance with Responsible AI principles. Communicate complex technical results to stakeholders and provide actionable recommendations on model performance and risk.
Required Qualifications
- Excellent written and verbal communication
- Comfortable and effective when interacting with a wide range of business partners and stakeholders
- Ability to develop and maintain strong internal relationships across business, technology, risk, and governance functions
- Ability to translate complex technical concepts and analytical findings into clear business language
- Creative, out-of-the-box thinker with strong conceptual and problem-solving skills
- Motivated to constantly identify innovative ways to enhance analytical solutions and AI implementation practices
- Capable of quickly identifying drivers of model performance variation, implementation risks, and monitoring concerns
- Ability to evaluate internally developed and vendor-provided AI solutions while balancing business value, performance, and governance requirements
- Proficiency in Python and modern machine learning frameworks and tools
- Experience developing, evaluating, and deploying machine learning and Generative AI solutions
- Strong understanding of model evaluation methodologies, experimentation, statistical testing, and performance monitoring
- Experience with structured and unstructured data, feature engineering, and model interpretability techniques
- Exposure to LLMs, agentic AI systems, and practical Generative AI applications
- Familiarity with model governance, Responsible AI principles, model validation, and model risk management practices
- Undergraduate degree in Science, Technology, Engineering, Mathematics, Economics, Finance, or a related quantitative discipline
- 5+ years of relevant experience in machine learning, advanced analytics, data science, model evaluation, or related fields
Desired Qualifications
- Graduate degree
- Experience working in financial services or regulated environments
- Familiarity with model validation, model risk management, governance, or audit processes
- Experience evaluating vendor-provided analytical solutions, AI platforms, or commercial Generative AI products
- Familiarity with causal inference, anomaly detection, or agentic AI systems
- Experience with SQL, Azure Cloud, Azure ML Services, or Databricks
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.