Project Lion - Lead Prompt Engineer - United States (Remote, Part-Time)
Remote · New York City, New York, United States or US
New York City, New York, United States or USRemotePart TimeSenior LevelMasters DegreeLarge
Type
Part Time
Level
Senior Level
Education
Masters Degree
Company size
Large
Job Summary
Lead Prompt Engineer sought to manage a team through the technical migration process of templates to LLM autoraters. Responsibilities include utilizing Automatic Prompt Generation tools, supervising Automated Prompt Optimization, drafting and refining prompts, monitoring model run outputs, and measuring autorater quality. Requires a Master's or Doctorate degree in relevant fields, at least 7 years of experience in prompt engineering, and strong data analysis skills.
Required Qualifications
- Native fluency in English.
- At least 7 years' experience as Prompt Engineer.
- Proven experience tuning Large Language Models (LLMs) for strict, structured outputs, complex classification tasks.
- Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools.
- Ability to quickly learn and master proprietary tools with minimal supervision.
- Excellent verbal and written communication skills.
Desired Qualifications
- Familiarity with enterprise-grade LLM interfaces like the Goose API.
- Experience in AI model evaluation, data science, computational linguistics, or software engineering.
- Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows.
- Linguistic expertise, including an understanding of semantics and logic.
Additional Requirements
- Must be based in United States.
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.