Safeguards Enforcement Analyst, Chem & Explosives Harms

About the role

As an Enforcement Analyst focused on Chem & Explosives Harms, you will play a critical role in protecting against the misuse of AI systems for chemical and explosives harms. You will enforce our Usage Policy with a specific focus on detecting and mitigating these risks, investigating potential violations, and help continuously strengthen our safeguards. The work sits at the intersection of chemical and explosives threat analysis and platform enforcement: you will read real model interactions and make fast, well-reasoned calls about whether activity is benign research or a credible attempt at harm.

This role is a fit for someone who understands the dual-use nature of chemistry and explosives technologies well enough to separate the benign from the malicious — and who acts decisively under ambiguity. You will own and continuously improve the enforcement monitoring workflows for this harm area, and you will work closely with Policy, Threat Intelligence, Data Science, and Engineering matrix partners to accomplish tasks at scale. Safety is core to our mission, and your work will directly protect individuals, communities, and critical systems from AI-facilitated weapons harm.

Important context for the role: In this position you may be exposed to and engage with explicit content spanning a range of topics, including material of a sexual, violent, or psychologically disturbing nature. The role also carries a shared on-call responsibility across the Policy and Enforcement teams.

Key responsibilities

• Enforce Usage Policies with a specific focus on detecting and mitigating potential chemical and explosives risks and harmful use of AI systems.
• Take ownership of enforcement monitoring workflows for the chemical and explosives harm area, improving end-to-end detection, investigation, triage, and escalation processes.
• Monitor and analyze platform activity to identify emerging patterns related to chemical and explosives threats (within the broader CBRNE landscape) that may require policy updates or enforcement action.
• Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy across a technically complex content surface.
• Conduct thorough investigations of potential violations, gathering and documenting evidence to support enforcement decisions.
• Proactively surface trends and propose improvements to detection methods and review workflows without waiting to be directed.
• Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for policy violations.
• Partner with Policy and Threat Intelligence teams to understand potential exploits and contribute to risk-assessment frameworks, and partner with engineers iterating on safety systems.
• Provide enforcement-grounded feedback on policy gaps, and handle escalations and time-sensitive situations related to chemical and explosives policy violations.

Minimum qualifications

• Hold a degree in a chemistry-related field (e.g., chemistry, chemical engineering, materials science) and/or relevant professional experience in a related field.
• Possess experience in Trust & Safety, content moderation, or policy enforcement at platform scale, including working with generative AI tools to refine and optimize content review and enforcement workflows.
• Possess experience in utilizing AI too