Most people who don't get in fail the screening, not the CV. Five minutes here first: How to pass the Turing assessment and interviews.
What the work is
About the Role
We are seeking highly qualified Domain Experts (SMEs) to support the evaluation, testing, and improvement of advanced Large Language Models (LLMs). You will apply your subject-matter expertise to assess AI-generated responses, identify knowledge gaps, design challenging prompts, and improve model accuracy, reliability, and reasoning.
Key Responsibilities
- Create complex, domain-specific prompts to test LLM capabilities.
- Evaluate AI-generated responses for factual accuracy, reasoning, relevance, and overall quality.
- Identify factual errors, logical inconsistencies, knowledge gaps, and model weaknesses.
- Develop challenging test cases and edge cases that expose model limitations.
- Provide clear, detailed, and evidence-based feedback to improve model performance.
Who gets hired
- Master’s degree or higher in a relevant field.
- At least three years of professional, research, or teaching experience.
- Excellent written English communication skills.
- Strong analytical and critical-thinking abilities.
- Exceptional attention to detail.
Preferred Qualifications
- Experience working with LLMs or Generative AI.
- Familiarity with prompt engineering, AI evaluation, or model testing.
- Experience designing challenging prompts, identifying edge cases, or stress-testing AI models.
Ideal Candidate
The ideal candidate is curious, detail-oriented, and deeply knowledgeable in their field. They enjoy solving complex problems, challenging assumptions, and identifying subtle factual or reasoning errors. Experience designing prompts that uncover model limitations and improve AI performance will be a strong advantage.
The platform posted this on 12 Oct 2026.