AI Research Engineer
On-site · Bengaluru, Karnataka, India
Job Summary
AI Research Engineer role focused on evaluating and advancing the capabilities of coding agents.Responsibilities include defining what good looks like for long-horizon coding agents, building evaluation datasets and methodologies, mining production data for failure modes, and conducting training, fine-tuning, RL, memory, and prompt-optimization experiments to translate research into shipped improvements. You will architect the next version of the Emergent agent, characterize agent behavior with deep, evidence-grounded analysis, design and ship evaluations across tool use, code correctness, security, and reliability, drive significant performance gains, participate in public benchmarks, and own end-to-end work from hypothesis to post-launch measurement. Requires 5–8 years AI experience, strong Python (Go a plus), experience with transformers and agent frameworks, eval harnesses, and a track record of moving benchmark numbers with rigor.
Required Qualifications
- 5–8 years of AI experience
- Hands-on with Python (Go a plus) for research workflows
- experience training and fine-tuning models or designing rigorous evaluations
- ability to design and run evaluations across reasoning, planning, tool use, code correctness, long-horizon execution, security, and agent reliability
- independence and leadership presence
- ability to defend benchmark metrics and ensure rigorous measurement
- comfort with probabilistic/subjective systems and data-driven decision making
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.