What the work is
About the Role
Typical work includes recurring side-by-side evaluations and legal dataset generation: you'll compare AI-generated legal work, judge which response is stronger and why, and create realistic in-house legal tasks and reference answers.
What You'll Do
- Compare pairs of responses to in-house legal tasks (contract review, policy and compliance questions, risk assessments and business-facing legal advice) and decide which is stronger, with clear reasoning
- Write concise justifications grounded in the source documents and applicable US law
- Create realistic legal prompts, fact patterns and model answers drawn from your in-house experience
- Flag errors, gaps and risky advice in AI-generated legal content
- Attend onboarding and calibration sessions
You're a Good Fit If You
- Are admitted to practice in at least one US state (active bar membership)
- Have 3+ years of legal practice, including in-house experience advising a business on contracts, compliance, employment, risk or disputes
- Hold a J.D. from an ABA-accredited law school
- Write clearly and pay close attention to detail
Who gets hired
- 2+ years of experience at an AmLaw 100 firm (strongly preferred)
- Prior data annotation, AI evaluation or legal-benchmark experience
Role Highlights
- Evergreen talent pool — apply once and be considered for ongoing projects as they launch
- Fully remote, flexible hours; recurring tasks as new work comes up
- Applications reviewed on a rolling basis
The platform posted this on 23 Oct 2026.