Domain Expert- Music

An older role: first posted 64d ago, and Turing still listed it when we checked today. Newer roles tend to fill faster. See the jobs hiring now.

What the work is

Role Overview

We are seeking a highly qualified Music Domain Expert to evaluate and improve Large

Language Models (LLMs). You will design challenging prompts, assess factual accuracy and reasoning, and identify knowledge gaps within music theory, genres, composers, artists, production, instruments.

Key Responsibilities

• Create advanced prompts covering music theory, genres, composers, artists, production instruments.
• Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.

• Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
• Develop benchmark datasets and adversarial test cases.

• Provide evidence-based feedback with reliable references.
• Collaborate with AI researchers to improve model performance.

• Maintain high annotation quality and documentation

Minimum Qualifications

• Master's degree or higher in any field; degrees in Music, Music Theory, Musicology, Ethnomusicology, Music Education, Music Production, Audio Engineering, Performing Arts, or other music-related disciplines are preferred.
• Strong knowledge of music, including music theory, composition, genres, composers, artists, instruments, music history, production techniques, notation, and contemporary music trends.

• 3+ years of relevant professional experience, preferably in music education, performance, composition, music production, journalism, research, content creation, audio engineering, or a related field.
• Excellent written English, research, and analytical skills.

• Strong attention to detail and ability to evaluate music-related information accurately, identify factual inconsistencies, and assess reasoning across diverse musical topics.

Preferred Qualifications

• Experience with LLMs, Generative AI, prompt engineering, or AI evaluation.
• Published research, industry recognition, or teaching experience is a plus.

• Ability to work independently and provide objective, evidence-backed reviews.

Offer Details

• Commitments Required: 40 hours per week with at least 4 hours PST overlap
• Employment type: Contractor assignment (no medical/paid leave)

• Duration of contract: 8 weeks.

Application Process

• Complete the assessment shared with you.
• Our team will evaluate your submission.

• Selected candidates will be contacted regarding the next steps.

Pay

See listing, fully remote. How payouts and tax work.