English
Hebrew
Mercor Is Hiring A Senior Content Reviewer
🚀 Join Mercor as an AI Model Evaluator!
Mercor connects top-tier creative and technical talent with leading AI research labs. Situated in San Francisco, our esteemed investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. We're looking for passionate individuals to evaluate AI models — a flexible opportunity to contribute to cutting-edge AI development!
About The Job
Position: AI Model Evaluator
Type: Full-time or Part-time Contract Work
Compensation: $41/hour
Location: Restricted to Israel and USA
Commitment: Flexible hours 🕒
Role Responsibilities
- 📝 Evaluate LLM-generated responses on their ability to effectively answer user queries.
- 🔍 Conduct fact-checking using trusted public sources and external tools.
- 🎯 Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies.
- 🧠 Assess reasoning quality, clarity, tone, and completeness of responses.
- 🤖 Ensure model responses align with expected conversational behavior and system guidelines.
- 📊 Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines.
Qualifications
Must-Have ✅
- Bachelor’s degree 🎓
- Native speaker or ILR 5 / C2 proficiency in Hebrew
- Extensive experience with large language models (LLMs)
- Excellent writing skills ✍️
- Strong attention to detail 🔍
- Versatility across topics, domains, and customer requirements
- Background in structured analytical thinking
- Excellent college-level mathematics skills 📐
Preferred 🌟
- Experience with RLHF, model evaluation, or data annotation
- Proficiency in writing or editing high-quality content
- Familiarity with evaluating multiple outputs and making nuanced judgments
- Knowledge of evaluation rubrics, benchmarks, or quality scoring systems
Compensation & Legal
This is an hourly contractor position.
Application Process (20–30 mins)
- Upload your resume 📄
- Complete an AI interview based on your resume 🤖
- Submit the application form ✅
Resources & Support
For detailed information about the interview process and platform, visit: https://talent.docs.mercor.com/welcome/welcome
Need assistance? Reach out to us at: support@mercor.com
🌟 Our team reviews applications daily. Be sure to complete your AI interview and application steps to be considered for this exciting opportunity!