What You'll Do

• Create advanced prompts covering music theory, genres, composers, artists, production instruments.
• Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
• Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
• Develop benchmark datasets and adversarial test cases.
• Provide evidence-based feedback with reliable references.
• Collaborate with AI researchers to improve model performance.
• Maintain high annotation quality and documentation

What We're Looking For

• Master's degree or higher in a discipline related to Music.
• 3+ years of professional, research, or teaching experience.
• Excellent written English and analytical skills.
• Strong attention to detail.
• Experience with LLMs, Generative AI, prompt engineering, or AI evaluation.
• Published research, industry recognition, or teaching experience is a plus.
• Ability to work independently and provide objective, evidence-backed reviews.