hiringremote.Get free job alerts

AI Safety Annotation Reviewer

See listing · Turing · remote

The platform doesn't say which countries can apply. Check on its page before you sign up.

Check history

CheckedStatusSlots leftChangeHow
22 Oct 2026Open––Script, platform’s board

The script reads the platform’s own job board every night. A job not confirmed for 10 days comes off the list.

Most people who don't get in fail the screening, not the CV. Five minutes here first: How to pass the Turing assessment and interviews.

What the work is

Role Overview

A US based AI company that is at the forefront of AI research is looking for a Team Lead to oversee a team of business analysts. This opportunity is tailored for professionals who have experience in leading teams and has interest in supporting the development of solutions at the cutting-edge of technology.

Job Responsibilities

  • Audit trainer-submitted evaluations for policy misapplication, incomplete reasoning, scoring drift, schema errors, and annotation inconsistencies.
  • Apply a detailed AI safety policy framework consistently across high-stakes review tasks.
  • Identify individual and systematic errors in human-generated annotations and written assessments.
  • Validate annotation completeness, scoring accuracy, policy alignment, and adherence to required schemas.
  • Provide direct, constructive feedback to trainers and recommend corrective actions when quality issues are identified.
  • Document recurring error patterns and contribute to quality improvement, calibration, and reviewer training initiatives.
  • Maintain accuracy and consistency while working under time-sensitive conditions and handling sensitive content.

Who gets hired

  • Sharp attention to detail and strong analytical and logical reasoning skills.
  • Demonstrated experience identifying systematic errors in human-generated annotations, evaluations, or written assessments.
  • Ability to quickly understand and consistently apply detailed policy guidelines.
  • Native-level English fluency and strong written communication skills.
  • Comfort providing clear, direct, and constructive feedback.
  • Strong understanding of US cultural context and communication norms.
  • Ability to work independently, manage priorities, and maintain quality under time pressure.
  • Availability to commit to 40 hours per week; immediate availability is preferred.

Preferred Qualifications

  • Experience in AI annotation review, Trust & Safety quality assurance, test engineering, content moderation, or editorial fact-checking.
  • Previous experience with schema validation, policy compliance reviews, annotation completeness checks, or quality auditing.
  • Experience working with sensitive or high-stakes content.

Importante Note: This project includes sensitive content involving topics such as self-harm, violence, and abuse. Appropriate waivers, support resources, and wellbeing measures will apply.

Benefits

  • Opportunity to work on cutting-edge AI projects.
  • Competitive compensation.
  • Flexible working hours and remote work environment.

Application Process

  • Shortlisted candidates will be reached out.

The platform posted this on 21 Oct 2026.

More jobs like this

Open the full list
  1. Posted 21 OctDomain Contributor - Evaluation Specialist$30–60/hrmicro120 slots leftWorldwide except 21 placesWorldwide except 21 placesChecked auto, 22 Oct
  2. Posted 20 OctAI Voice Recording Contributor - Scots (Mid/Central Scots)$20/hrRWS TrainAIUKUKChecked auto, 22 Oct
  3. Posted 20 OctEvaluation Specialist/Recent Grad$20–60/hrmicro15 slots leftWorldwide except 21 placesWorldwide except 21 placesChecked auto, 22 Oct
  4. Posted 20 OctAI Voice Recording Contributor - Arabic (Gulf)$11/hrRWS TrainAIKWKWChecked auto, 22 Oct
  5. Posted 20 OctAI Voice Recording Contributor - Arabic (Gulf)$7.5/hrRWS TrainAIBHBHChecked auto, 22 Oct