Evaluation Specialist Sr
RemoteUnited States
Job Summary
Design and implement end-to-end evaluation systems to assess program impact, resource adoption, and learning outcomes for the VHA AI Education Hub. Apply a mixed-methods approach including content analysis, quantitative tracking, surveys, focus groups, and structured interviews to generate actionable insights on performance. Oversee the generation and communication of performance reports, translating findings into strategic recommendations and integrating them into current program strategies. Meet regularly with Government stakeholders to discuss evaluation progress, present findings, propose new assessment initiatives, and establish organizational priorities. Develop data-driven sustainment and expansion recommendations that guide the long-term growth of AI education resources, drawing on evaluation evidence and emerging federal healthcare workforce needs. Conduct secondary research and environmental scans to benchmark the VHA AI Education Hub against comparable federal, healthcare, and AI literacy programs, informing continuous improvement efforts.
Required Qualifications
- Minimum 5 years of experience designing and implementing program evaluation systems
- demonstrated expertise in both quantitative and qualitative assessment methodologies
- Bachelor's degree (BA/BS) in Evaluation, Public Health, Public Policy, Social Sciences, Education, or a related field
- Prior experience supporting federal agency clients
- ability to navigate government stakeholder environments effectively
- Ability to obtain and maintain VA network access and meet all VHA personnel security requirements, including applicable background investigation requirements for contractor personnel
- Must be legally authorized to work in the United States without sponsorship, now or in the future, in compliance with federal contractor employment eligibility requirements
- Demonstrated proficiency with evaluation tools and methods including survey design, focus group facilitation, structured interviews, and secondary/desk research
- experience translating findings into executive-level reports and strategic recommendations
Desired Qualifications
- Experience evaluating technology adoption, digital literacy, or AI/emerging technology training programs within a federal or large healthcare organization
- Familiarity with VHA or broader VA organizational structures, workforce development priorities, or health informatics initiatives
- Proficiency with data visualization or reporting tools (e.g., Power BI, Tableau, or equivalent) to communicate evaluation findings to non-technical government audiences
- Master's degree in Evaluation, Public Health, Organizational Development, or a related discipline
- Knowledge of federal performance management frameworks such as OMB guidance, GPRA/GPRAMA, or HHS/VA evaluation policies that govern program assessment and reporting
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.