Mercor Is Hiring A Content Reviewer

Join Mercor as an AI Model Evaluator 🤖

Mercor is at the forefront of connecting top-tier creative and technical talent with leading AI research laboratories. Based in San Francisco and backed by prominent investors such as Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey, we offer exciting opportunities for AI enthusiasts.

Position Overview

• Role: AI Model Evaluator
• Type: Full-time or Part-time Contract
• Compensation: $41/hour
• Location: Restricted to Israel and USA
• Commitment: Flexible hours

Role Responsibilities 📝

• Evaluate responses generated by large language models (LLMs) for effectiveness in addressing user queries
• Conduct fact-checking using trusted public sources and external tools
• Create high-quality human evaluation data by annotating strengths, areas for improvement, and factual inaccuracies
• Assess reasoning quality, clarity, tone, and completeness of responses
• Ensure model replies align with conversational expectations and system guidelines
• Maintain consistency in annotations by following established taxonomies, benchmarks, and detailed evaluation guidelines

Qualifications 🎓

Must-Have

• Bachelor’s degree
• Native Hebrew speaker or ILR 5 / C2 on CEFR scale
• Significant experience with large language models (LLMs)
• Excellent writing skills
• Strong attention to detail
• Adaptability across diverse topics and domains
• Background in structured analytical thinking
• Excellent college-level mathematics skills

Preferred

• Previous experience with RLHF, model evaluation, or data annotation work
• Experience in writing or editing high-quality content
• Skill in comparing multiple outputs and making nuanced judgments
• Familiarity with evaluation rubrics, benchmarks, or quality scoring systems

Compensation & Legal Details 💼

This is a contract role paid hourly.

Application Process 🚀 (Approx. 20–30 minutes)

1. Upload your resume
2. Complete an AI interview based on your resume
3. Submit the application form

Resources & Support 💡

• Learn more about the interview process and platform details at this link
• For assistance, contact us at support@mercor.com

PS: Our team reviews applications daily. Please ensure you've completed your AI interview and application steps to be considered for this exciting opportunity! 🚀