Subject Matter Expert - Election Integrity, Violent Extremism, and Fraud
On-siteLondon, England, United Kingdom or New York City, New York, United States
Job Summary
Set standards and escalation thresholds for election integrity, violent extremism, and fraud content while defining detection strategies and enforcement workflows. Own end-to-end operations of review processes, including task routing, queue management, quality assurance, and SLA monitoring, serving as the primary point of contact for human graders and partners. Drive model launch evaluations on novel cases, validate model outputs against risk thresholds before open weights ship, and partner with engineering to design detection pipelines and automated enforcement systems. Develop internal documentation, decision trees, and review guidelines to enable consistent enforcement at scale, while identifying emerging misuse patterns and coordinating reporting obligations to external bodies like election authorities and financial partners. Stay current on evolving legal frameworks and threat landscapes to keep workflows ahead of the threat landscape.
Required Qualifications
- Deep subject matter expertise in one or more of: election integrity, disinformation and influence operations, counterterrorism and violent extremism, or fraud and deception (e.g., scams, phishing, impersonation, financial fraud)
- Experience in trust & safety, content moderation operations, or policy enforcement with direct exposure to election-related harms, terrorist or violent extremist content, fraud, or related harm areas
- Experience managing or coordinating content review operations, including quality assurance and workflow management
- Experience standing up and scaling policy enforcement or content review workflows
- Proficiency in SQL and/or other data analysis tools to monitor workflow health, review-queue metrics, and enforcement trends
- Track record of identifying emerging risks and communicating findings clearly to cross-functional stakeholders across Product, Policy, Engineering, and Legal
- Sound judgment under time pressure and comfort making high-stakes decisions, including ones that affect whether a model ships
- Familiarity with content classification frameworks for terrorist and violent extremist material, with influence-operation taxonomies (e.g., ABCDE / DISARM frameworks), and with common fraud and scam typologies
- Familiarity with relevant legal and regulatory frameworks, including the EU Digital Services Act, the EU TCO Regulation, election-related transparency laws, consumer-protection and anti-fraud regulations, or equivalent international frameworks
- Experience with generative AI products and an understanding of how AI systems can be misused to generate or facilitate influence operations, violent extremism, or fraud
- Experience with hash-matching or perceptual hashing technologies used in detecting known violent extremist content
- Familiarity with provenance and content-authenticity technologies (e.g., C2PA) and their role in election integrity and anti-fraud efforts
- Experience designing or evaluating trauma-informed support structures and wellness protocols for content reviewers
- Proficiency in Python for workflow automation or data analysis
- Additional language proficiency beyond English
Desired Qualifications
- Must be available for weekend shifts
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.