Governance & Trust – Safety Specialist
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.
Role Description
This role involves contributing to AI safety by annotating and evaluating AI behaviors to ensure the systems are safe.
- Produce high-quality human data by annotating AI outputs against safety criteria (e.g., bias, misinformation, disallowed content, unsafe reasoning, etc).
- Apply harm taxonomies and guidelines consistently, even when tasks are ambiguous.
- Document your reasoning to improve guidelines.
- Collaborate to provide the human data that powers AI safety research, model improvements, and risk audits.
Qualifications
- Background in trust & safety, governance, or policy-to-product frameworks.
- Experience with harm taxonomies, safety-by-design principles, or regulatory frameworks (EU AI Act, NIST AI RMF).
- Skilled at translating abstract policies into concrete evaluation criteria.
- Motivated by reducing user harm and ensuring systems are safe, ethical, and compliant.
- Examples of past titles: Trust & Safety Analyst, Online Safety Specialist, Policy Researcher, Governance Specialist, UX Researcher, Risk & Policy Associate, Regulatory Affairs Analyst, Safety Policy Manager, Ethics & Compliance Coordinator.
Requirements
- No prior annotation experience is required; ability to make careful, consistent decisions in ambiguous situations is essential.
- Willingness to review AI outputs that touch on sensitive topics such as bias, misinformation, or harmful behaviors.
- Participation in higher-sensitivity projects is optional and supported by clear guidelines and wellness resources.
Benefits
- Work at the frontier of AI safety, providing the human data that shapes how models behave.
- Gain experience in a rapidly growing field with direct impact on how labs deploy advanced systems.
- Be part of a team committed to making AI systems safer, trustworthy, and aligned with human values.
Company Description
Mercor is a talent marketplace that connects top experts with leading AI labs and research organizations.
- Our investors include Benchmark, General Catalyst, Adam D’Angelo, Larry Summers, and Jack Dorsey.
- Thousands of professionals across law, engineering, research, and creative fields collaborate with Mercor on frontier AI projects shaping the future.