Senior Data Scientist (GenAI)
On-site · US
Job Summary
Senior Data Scientist (GenAI) across the AI Platform to drive RAG retrieval relevance and LLM answer quality for emails and attachments; define evaluation datasets, labeling pipelines, metrics, and experiments to tune chunking, embeddings (Flamingo API), hybrid search, filters, and grounding; collaborate with engineers and business users to translate feedback into actionable metrics and backlog items; assess LLM answer quality, failure patterns, and cost/performance trade-offs for summarization and indexing.
Required Qualifications
- Applied ML/Data Science with strong evaluation discipline
- Python (pandas, Jupyter/Notebooks) + SQL
- Information retrieval / RAG evaluation: Recall@K, MRR, nDCG, citation grounding
- Experience with LLMs: prompting, grounding, long-context handling, cost/latency awareness
- Building reproducible pipelines and dashboards
- Strong communicator: translating business questions into metrics and experiments
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.