Software Engineer, AI Platforms and Products
$110,000–$130,000 year
HybridNew York City, New York, United States or New York, United States
Job Summary
Design, build, and maintain scalable backend services and APIs for a central AI platform enabling teams to deploy large language models across journalism and business operations. Contribute to core components including prompt and workflow management, vector database infrastructure, and retrieval-augmented generation pipelines. Develop orchestration layers for multi-step AI workflows, implement data pipelines, and ensure code quality, security, and observability. Collaborate with editorial, product, and data teams to translate requirements into platform capabilities while participating in code reviews and knowledge sharing. Work remotely and in-office in New York City on a hybrid schedule.
Required Qualifications
- 2+ years of software engineering experience, with a focus on backend development
- 2+ years of experience in one or more backend programming languages such as Python or Go
- Experience building and operating APIs and services in a production environment
- Exposure to building applications with Large Language Models (LLMs), or familiarity with the surrounding ecosystem (e.g., orchestration, retrieval-augmented generation)
Desired Qualifications
- Experience with MLOps, including building systems for model and prompt evaluation, tracing, and monitoring
- Experience with vector databases and embedding models or services
- Experience with information retrieval or search systems
- Experience building RAG systems or agentic AI workflows
- Experience with prompt engineering and prompt management systems
- Familiarity with containerization and orchestration technologies like Docker and Kubernetes
- Experience with infrastructure as code (e.g., Terraform, CloudFormation)
- Experience with cloud computing platforms like GCP or AWS and their associated services (e.g., Cloud Functions, S3, RDS)
- Experience with event-driven architectures and technologies such as Kafka or Pub/Sub
- Familiarity with LLM orchestration and agentic frameworks
- Experience with GraphQL
- Experience designing distributed systems at scale
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.