AI Development Toolchain Engineer
On-sitePune, Maharashtra, India
Job Summary
Architect and build Rubiscape's internal AI developer platform, including custom LLM agents, IDE plugins, CLI tools, and spec-to-code automation pipelines integrated into the engineering workflow. Design and maintain CI/CD hooks that run AI-assisted code review, spec compliance checks, and automated test generation within every pull request pipeline. Build infrastructure for prompt versioning, agent configuration management, and LLM call logging to ensure reproducibility and auditability of AI-generated code. Collaborate with Spec and Prompt Engineering teams to operationalize prompt libraries as versioned services. Evaluate and integrate best-in-class external AI developer tools while adapting them to the platform's security requirements. Define and monitor toolchain performance metrics such as code acceptance rates and developer satisfaction scores. Document architecture and runbooks to enable full engineering org adoption of AI-assisted workflows.
Required Qualifications
- 4+ years of software engineering or platform/DevOps engineering experience
- at least 1–2 years building or operating internal developer platforms, CLI toolchains, or developer productivity systems
- Strong Python and/or TypeScript skills
- demonstrated experience building production-grade automation scripts, developer tools, or engineering platform components
- Hands-on experience integrating LLM APIs (OpenAI, Anthropic, or equivalent) into automated workflows
- including prompt management, response parsing, and error handling
- Solid understanding of CI/CD systems (GitHub Actions, GitLab CI, or Jenkins)
- the ability to design and implement custom pipeline steps and quality gates
- Experience with containerisation (Docker, Kubernetes)
- cloud infrastructure (AWS, Azure, or GCP) relevant to deploying and scaling internal toolchain services
- B.E. / B.Tech in Computer Science, Software Engineering, or a related discipline
Desired Qualifications
- Experience building VS Code extensions, Language Server Protocol (LSP) integrations, or other IDE tooling that surfaces AI assistance directly in the developer's workflow
- Familiarity with LangChain, LlamaIndex, or multi-agent orchestration frameworks used to build complex, stateful AI coding agents
- Prior work at a platform engineering, developer experience (DevEx), or internal tools team at a high-growth SaaS company
- Knowledge of enterprise security and compliance requirements (SOC 2, ISO 27001) as they apply to LLM API usage, data residency, and code confidentiality
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.