An older role: first posted 88d ago, and AI expert network still listed it when we checked today. Newer roles tend to fill faster. See the jobs hiring now.
What the work is
Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models.
Overview
Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models from the ground up. We're seeking talented Linguists and Instructional Designers with deep experience translating ambiguous program requirements into clear, unambiguous rater guidelines to bring precision and consistency to our AI training data — working across domains from finance and retail to insurance, legal, and sports.
Key Responsibilities
- Guide research and program teams to close the gap between ambiguous program requirements and rater-ready instructions across a range of subject-matter domains.
- Design clear, non-contradictory rating guidelines and rubrics that raters can apply consistently, including under edge cases.
- Evaluate draft guidelines for ambiguity, internal contradiction, and coverage gaps, and revise until raters can apply them without escalation.
- Translate program specifications from domains such as finance, retail, insurance, legal, and sports into precise, discipline-specific rater instructions.
- Collaborate with other subject matter experts and program leads to ensure consistency and accuracy across guideline sets.
Who gets hired
Core Qualifications
- 3+ years of professional experience in linguistics, instructional design, technical writing, or a closely related field, with direct experience writing or refining guidelines/rubrics for human raters in a GenAI/RLHF context.
- Demonstrated ability to work across multiple subject-matter domains (e.g., finance, retail, insurance, legal, sports) and translate domain-specific nuance into clear, unambiguous instructions.
- Strong track record of resolving ambiguity and contradiction in written specifications — able to point to concrete before/after examples.
- Demonstrable career progression.
- Ability to engage reliably for at least 35 hours/week during weekdays.
- Strong written communication skills and the ability to explain complex or nuanced guidance clearly and precisely.
Pay
$45–65/hr, fully remote.