Safeguards Enforcement Analyst, Bio Harms

About the role

As an Enforcement Analyst focused on Bio Harms, you will play a critical role in protecting against the misuse of AI systems for biological and related CBRNE harms. You will enforce our Usage Policy with a specific focus on detecting and mitigating bio risks, investigating potential violations, and help continuously strengthen our safeguards.  The work sits at the intersection of biosecurity threat analysis and platform enforcement: you will read real model interactions and make fast, well-reasoned calls about whether activity is benign research or a credible attempt at harm.

This role is a fit for someone who understands the dual-use nature of biology and enabling technologies well enough to separate the benign from the malicious. You will own and continuously improve the enforcement monitoring workflows for the bio-harms area, and you will work closely with Policy, Threat Intelligence, Data Science, and Engineering cross-functional partners to accomplish tasks at scale. Safety is core to our mission, and your work will directly protect individuals, communities, and critical systems.

Important context for the role: In this position you may be exposed to and engage with explicit content spanning a range of topics, including material of a sexual, violent, or psychologically disturbing nature. The role also carries a shared on-call responsibility across the Policy and Enforcement teams.

Key responsibilities

• Enforce Usage Policies with a specific focus on detecting and mitigating potential bio risks and harmful use of AI systems.
• Take ownership of enforcement monitoring workflows for the bio-harms area, improving end-to-end detection, investigation, triage, and escalation processes.
• Monitor and analyze platform activity to identify emerging patterns related to biological (and adjacent chemical, radiological, nuclear, and explosive) threats that may require policy updates or enforcement action.
• Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy across a technically complex content surface.
• Conduct thorough investigations of potential violations, gathering and documenting evidence to support enforcement decisions.
• Proactively surface trends and propose improvements to detection methods and review workflows.
• Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for bio-related policy violations.
• Partner with Policy and Threat Intelligence groups to understand potential exploits and contribute to risk-assessment frameworks, and partner with engineers iterating on safety systems.
• Provide enforcement-grounded feedback on policy gaps, and handle escalations and time-sensitive situations related to potential bio-related Usage Policy violations.

Minimum qualifications

• Hold a degree in a bio-related field (e.g., microbiology, molecular biology, biochemistry, public health) and/or relevant professional experience in a related field.
• Possess experience in Trust & Safety, content moderation, or policy enforcement at platform scale, including working with generative AI tools to refine and optimize content review and enforcement workflows.
• Possess experience in utilizing AI tools to develop data dashboards for metrics collection in support of continuous improvement efforts.
• Can analyze com