AI Engineering Lead, Product Analytics
On-siteToronto, Ontario, Canada
Job Summary
Build and maintain shared Git repositories, reusable components, and data-access standards for a team of 35 analysts supporting 60+ products. Develop production-grade AI agents by extending individual prototypes into broadly useful tools and establish evaluation standards that define what production means for the team. Diagnose pipeline gaps between data collection and self-service tooling, advocate for necessary sources into the data lake, and set build conventions to keep artifact management fast and reliable. Scale adoption across the group by teaching infrastructure usage and navigating TR's AI governance landscape to ensure compliance without blocking shipping.
Required Qualifications
- Roughly 2+ years of serious hands-on building with modern AI tooling
- Fluency across AI assistants
- Coding in an AI development environment
- Patterns of agent design
- Ability to build production-grade tools and shared infrastructure
- Experience taking someone else's prototype and generalizing it into reusable infrastructure
- Working knowledge of how to evaluate AI systems
- Ability to define success criteria for AI evaluations
- Ability to build evals
- Ability to use evals to decide what is ready for production
- Ability to set evaluation standards for others
- Ability to improve evaluation standards over time
- Substantial experience building structure and programs that scale a capability across a whole team
- Experience with standards, processes, cadences, and documentation
- Strong eye for detail
- Discipline to specify what success looks like before building
- Discipline to verify success continuously after building
- Judgment to know when to push the team toward AI
- Judgment to know when a workflow is not ready for AI
- Credibility to articulate vision to analysts and product leaders
- 4+ years driving change across teams and with senior stakeholders
- Track record of getting people to adopt new ways of working
- 5+ years in analytics or a closely related data discipline
- Working command of a modern stack including Snowflake, SQL, Python, BI tools (Power BI, Tableau), or Streamlit
- Ability to lead technical work
- Ability to judge tool quality
- Awareness of AI governance and compliance considerations
Desired Qualifications
- Project tracking and program coordination experience (e.g., Linear, Azure DevOps, SharePoint)
- Experience in or alongside product teams
- SaaS experience
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.