Agent Configuration Specialist
$78,000–$115,000 year
HybridToronto, Ontario, Canada
Job Summary
Translate business processes and solution designs into configured AI agents and workflows on Zafin AIOS, defining instructions, prompts, tools, and logic while establishing guardrails and human review controls. Connect agents to enterprise tools and APIs, then test behavior against representative scenarios and edge cases before deployment. Diagnose configuration defects, support releases across development and production environments, and monitor performance to drive targeted improvements. Create reusable configuration templates and documentation to accelerate future delivery. Work with engineers, architects, and stakeholders to move solutions from initial configuration through continuous improvement.
Required Qualifications
- 3–6 years of experience configuring, implementing or supporting enterprise software, workflow automation, low-code/no-code platforms, AI-enabled applications or comparable production systems
- Demonstrated ability to translate business processes and solution requirements into configurable workflows, rules, actions, decision logic and system behaviours
- Hands-on experience configuring complex workflows or applications using visual builders, administrative consoles, rules engines, orchestration tools or comparable platform capabilities
- Practical understanding of generative AI concepts, including prompts, context, tool use, structured outputs, hallucination risk and the need for human review and operational guardrails
- Experience testing configured solutions using defined scenarios, expected outcomes, edge cases and failure conditions
- Strong troubleshooting skills and the ability to isolate whether an issue relates to configuration, data, integration, permissions, environment or underlying product behaviour
- Working knowledge of APIs and structured data formats such as REST, JSON or YAML, sufficient to configure and troubleshoot integrations using established patterns
- Experience moving configurations through development, testing and production environments using disciplined release, versioning and change-management practices
- Strong attention to detail and the judgment to balance delivery speed with quality, reliability and operational risk
- Clear written and verbal communication skills, including the ability to document configuration decisions and explain system behaviour to both technical and non-technical stakeholders
- Ability to work collaboratively with engineers, architects, evaluation specialists, product teams and client-facing stakeholders in a fast-moving delivery environment
Desired Qualifications
- Experience with an AI agent platform, generative AI application, workflow automation platform or low-code/no-code development environment
- Experience configuring prompts, tools, retrieval sources, agent instructions, workflow orchestration, human-in-the-loop steps or AI safety controls
- Familiarity with Git, CI/CD processes, API testing tools, scripting, etc.
- Experience with evaluation, monitoring or observability tools used to assess AI output quality and workflow reliability
- Experience delivering enterprise technology solutions in banking, financial services or another regulated environment
- Experience creating reusable templates, configuration standards, implementation playbooks or platform enablement materials
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.