Responsibilities
• Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and quality
• Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains
• Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking
• Identify unsafe outputs, hallucinations, reasoning failures, and policy violations
• Provide structured feedback to improve model alignment and safety performance
• Collaborate with AI researchers and safety teams on evaluation initiatives

Requirements
• Bachelor’s degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or related discipline
• 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or related field
• Excellent written English, critical thinking, and analytical reasoning skills
• Ability to consistently evaluate nuanced and policy-sensitive scenarios

Preferred
• Experience with AI Safety, RLHF, SFT, Trust & Safety, or AI evaluation
• Familiarity with safety policies, content moderation, or evaluation rubric development
• Experience reviewing complex, high-risk, or ambiguous content

How to Apply
Click "Apply" to be taken to the Mercor website. This is a fully remote contractor role with flexible hours.