Senior Lead Software Engineer, Full Stack (AI Platform & Knowledge Library) (Enterprise Platforms Technology)
$229,900–$262,400 year
On-siteNew York City, New York, United States or Richmond, Virginia, United States
Job Summary
Design and build the Content Moderation Knowledge Library, a RAG-backed corpus covering regulatory requirements, brand rules, claims, and disclosures. Own the embedding search pipeline, including chunking strategy, model selection, index refresh, and hybrid search. Lead Prompt MLOps by treating prompts as versioned artifacts and managing the evaluation loop against labeled production data. Own the AI content compliance and generation platform APIs, defining contracts and coordinating cross-team integrations. Design the agentic critic validation stream combining deterministic parallel validators with LLM-as-judge semantic validators. Lead technical design, produce architecture documents, conduct design reviews, and mentor engineers on RAG system design and production AI operations.
Required Qualifications
- Bachelor's Degree
- At least 6 years of experience in software engineering
- At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Desired Qualifications
- Master's Degree
- 4+ years of experience in Python
- 4+ years of experience building and operating retrieval-augmented generation (RAG) systems
- 3 + years of experience in applied AI/ML or LLM-based systems in production
- 3+ years of experience with vector search infrastructure (OpenSearch, Pinecone, PGvector, Weaviate, or equivalent)
- 3+ years of experience designing and owning shared platform APIs
- 2+ years of experience with AWS services (OpenSearch Service, S3, Lambda, SQS, or equivalent)
- Experience leveraging interactive AI tooling to accelerate productivity, utilizing capabilities beyond basic code completion
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.