Mercor Is Hiring A Content Moderator

Join Mercor as an AI Model Evaluator! 🚀

Mercor connects top-tier creative and technical talent with leading AI research labs. Based in San Francisco, our backing includes notable investors like Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Model Evaluator

• Type: Full-time or Part-time Contract Work
• Compensation: $41/hour
• Location: Restricted to Israel and USA

Role Responsibilities 🎯

• Evaluate LLM-generated responses for effectiveness in answering user queries.
• Conduct fact-checking using trusted public sources and external tools.
• Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies.
• Assess reasoning quality, clarity, tone, and completeness of responses.
• Ensure model responses align with expected conversational behavior and system guidelines.
• Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines.

Qualifications 📚

Must-Have ✅

• Bachelor’s degree
• Native speaker or ILR 5 / C2 proficiency in Hebrew
• Significant experience with large language models (LLMs)
• Excellent writing skills
• Strong attention to detail
• Adaptability across topics, domains, and customer requirements
• Background in domains requiring structured analytical thinking
• Excellent college-level mathematics skills

Preferred ⭐

• Experience with RLHF, model evaluation, or data annotation
• Experience in writing or editing high-quality content
• Experience comparing multiple outputs and making nuanced qualitative judgments
• Familiarity with evaluation rubrics, benchmarks, or quality scoring systems

Compensation & Legal 💼

• Hourly contractor role
• Paid weekly via Stripe Connect

Application Process ⏱️ (Takes 20–30 mins)

1. Upload your resume
2. Complete an AI interview based on your resume
3. Submit the application form

Resources & Support 🛠️

• Learn about our interview process and platform: https://talent.docs.mercor.com/welcome/welcome
• Need assistance? Reach out to: support@mercor.com

⭐ Our team reviews applications daily. Be sure to complete your AI interview and application steps to be considered for this exciting opportunity!