Cybersecurity for AI Safety (Contract)
RemoteUnited States
United StatesRemoteContractMasters DegreeMedium
ContractMasters DegreeMedium
Job Summary
Design realistic, expert-level cybersecurity prompts spanning application security, network security, cloud infrastructure, and secure software development. Evaluate AI-generated responses for technical accuracy, completeness, and practical usefulness while assessing model handling of sensitive, dual-use scenarios. Apply structured evaluation rubrics to annotate prompts and outputs with consistency, providing actionable feedback to improve frontier AI system safety and reliability. This role trains and evaluates next-generation AI systems within a multidisciplinary team focused on software security and vulnerability research.
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Cybersecurity, or a closely related technical field
- 5+ years of professional software engineering experience at a high-growth startup or established technology company
- Deep knowledge of cybersecurity principles, modern software systems, and secure development practices
- Excellent technical reasoning and strong written communication skills in English
- Sound judgment when working with sensitive or dual-use security topics
- The ability to apply detailed guidelines while maintaining high-quality, consistent evaluations
Desired Qualifications
- Experience in offensive security, penetration testing, vulnerability research, security engineering, or a related discipline
- Previous experience evaluating, reviewing, benchmarking, or red-teaming technical or AI-generated content
- Familiarity with AI evaluation, model assessment, or human-in-the-loop data annotation workflows
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.