Senior Financial Planning & Analysis (FP&A) SME (AI Evaluation) | U.S.
$114,400–$124,800 year
RemoteUnited States
Job Summary
Evaluate AI-generated financial analyses for technical accuracy, completeness, and quality of reasoning. Identify factual inaccuracies, unsupported assumptions, logical inconsistencies, and calculation errors within financial models, valuation methodologies, and investment analyses. Create, review, and refine finance-related prompts, benchmark responses, and evaluation datasets while applying detailed annotation guidelines consistently. Provide structured, actionable feedback to improve Large Language Model performance and collaborate with Project Managers, Quality Assurance teams, and AI Researchers to refine evaluation methodologies. Maintain productivity and quality standards while working independently in a remote environment. Successful completion of a Trial Gig is required before joining the production project. Compensation ranges from $55–$60 USD/hour for U.S. candidates.
Required Qualifications
- Significant practical experience in Investment Banking, Corporate Finance, or Transaction Advisory
- Strong knowledge of U.S. financial markets and corporate finance principles
- Exceptional analytical and critical thinking skills
- Advanced financial modeling and valuation capabilities
- Excellent written English communication skills
- Ability to independently evaluate complex financial analyses and articulate technical feedback
- Strong attention to detail and commitment to quality
- Availability beginning at 6:00 AM Pacific Standard Time (PST)
- Candidates must be able to commit to assigned work once projects are released and meet established turnaround times
- Led complex financial analyses or valuation engagements
- Reviewed or approved the work of other finance professionals
- Supported or led high-profile transactions
- Presented recommendations to executive leadership, investment committees, or clients
- Built financial models used in strategic business decisions
- Applied expert judgment to evaluate complex financial scenarios
- Successful completion of a Trial Gig designed to evaluate technical finance expertise, analytical reasoning, written communication, attention to detail, and the ability to assess AI-generated financial responses
Desired Qualifications
- Controller
- CFO
- FP&A Director
- Owned budgeting
- Built forecasting models
- Presented to executive leadership
- CFA (Completed or Candidate)
- CPA
- MBA (Finance)
- Chartered Accountant (CA)
- Investment Banking
- Big Four Transaction Advisory
- Valuation Advisory
- Private Equity
- Venture Capital
- Corporate Development
- Strategic Finance
- Financial Platforms
- Bloomberg Terminal
- Capital IQ
- FactSet
- Refinitiv
- PitchBook
- AI Model Evaluation
- Reinforcement Learning from Human Feedback (RLHF)
- Prompt Engineering
- AI Annotation
- Large Language Model (LLM) Evaluation
- AI Quality Assurance
- Benchmark Dataset Development
- Previous experience with any of the following is highly desirable: AI Model Evaluation, Reinforcement Learning from Human Feedback (RLHF), Prompt Engineering, AI Annotation, Large Language Model (LLM) Evaluation, AI Quality Assurance, Benchmark Dataset Development
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.