Software Engineer, Trust & Safety
$180,000–$310,000 year
HybridSan Francisco, California, United States
Job Summary
Own detection and prevention systems for fraud, abuse, spam, and malicious content across millions of daily users. Design and build scalable trust infrastructure including rate limiting, content scanning, anomaly detection, and account security. Build tools that empower internal support teams to investigate and act on suspicious or malicious activity. Investigate and resolve complex security incidents with limited context. Partner with engineering and product to balance security with user experience. Shape Gamma's long-term trust and safety strategy and technical roadmap, leveraging AI/LLM-based detection to stay ahead of AI-generated abuse. Build automated triage and investigation workflows that let a small team operate at the scale of a much larger one. Work in-office 4–5 days per week in San Francisco.
Required Qualifications
- 5+ years as a software engineer with a focus on abuse, spam, or fraud prevention
- Strong systems thinking and experience building highly available web APIs
- Proficiency in at least one programming language
- Comfort working across a modern web stack
- Hands-on experience implementing trust features like rate limiting, content detection, and fraud prevention
- Experience with event streaming systems (Redis, Kafka, or similar)
- Passion for security, user protection, and solving problems at scale
- Work in person 4–5 days per week in San Francisco
- Work in San Francisco
Desired Qualifications
- Experience with AI/LLMs for content moderation
- Familiarity with TypeScript
- Familiarity with Prisma
- Familiarity with Apollo GraphQL
- Familiarity with AWS
- Experience building AI-assisted moderation pipelines
- Using frontier models for automated abuse detection and response
- Familiarity with the evolving AI threat landscape—how generative models are being used for phishing, social engineering, and content abuse at scale
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.