Subject Matter Expert - Child Safety
On-siteLondon, England, United Kingdom or New York City, New York, United States
Job Summary
Set standards, definitions, and escalation thresholds for CSAM, CSEM, and online child sexual exploitation and abuse. Own end-to-end child safety content evaluation workflows, including task routing, queue management, quality assurance, and SLA monitoring. Serve as the primary point of contact for review partners, conducting onboarding, training, calibration, and ongoing support. Review novel or ambiguous flagged content to drive enforcement decisions and surface policy gaps to Alignment, Safety, and Policy teams. Partner with engineering to design detection models, hash-matching pipelines, and automated enforcement systems. Validate models against child safety risk thresholds before open weights ship and coordinate reporting obligations to external bodies like NCMEC. Identify emerging misuse patterns and stay current on evolving legal frameworks and enforcement best practices.
Required Qualifications
- Deep subject matter expertise in child safety, child sexual exploitation and abuse (CSEA), or online child protection.
- Experience in trust & safety, content moderation operations, or policy enforcement with direct exposure to child safety, CSAM/CSEM, or related harm areas.
- Experience managing or coordinating content review operations, including quality assurance and workflow management.
- Experience standing up and scaling policy enforcement or content review workflows.
- Proficiency in SQL and/or other data analysis tools to monitor workflow health, review-queue metrics, and enforcement trends.
- Track record of identifying emerging risks and communicating findings clearly to cross-functional stakeholders across Product, Policy, Engineering, and Legal.
- Sound judgment under time pressure and comfort making high-stakes decisions, including ones that affect whether a model ships.
- Familiarity with CSAM/CSEM classification standards (e.g., COPINE, SAM scale).
- Experience working with or reporting to NCMEC, IWF, or equivalent child safety reporting bodies.
- Familiarity with relevant legal and regulatory frameworks, including CSAM reporting obligations, KOSA, COPPA, or equivalent international frameworks.
- Experience with generative AI products and an understanding of how AI systems can be misused to generate or facilitate CSEA.
- Experience with hash-matching or perceptual hashing technologies used in CSAM detection (e.g., PhotoDNA, CSAI Match).
- Familiarity with age assurance technologies and their role in child safety enforcement.
- Experience designing or evaluating trauma-informed support structures and wellness protocols for content reviewers.
- Proficiency in Python for workflow automation or data analysis.
- Additional language proficiency beyond English.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.