Mercor Is Hiring A Bilingual Italian Language Specialist

Join Mercor—a leading platform connecting top-tier creative and technical talent with renowned AI research labs. We are currently seeking a

Bilingual Italian Generalist Evaluator Expert

Contract position with an opportunity to contribute to cutting-edge AI language model development from anywhere in the world.

Position Details

• Type: Contract
• Compensation: $25–$30/hour
• Location: Remote
• Duration: 2–4 months
• Commitment: 20+ hours/week

Role Responsibilities

• Author Italian/English prompt-golden answer pairs to train and evaluate advanced language models.
• Create detailed prompts in Italian and/or English, ensuring natural phrasing and relevance for Italian-speaking users in Switzerland and Italy contexts.
• Establish high-level expectations for correct responses and develop comprehensive rubrics considering linguistic nuances, tone, and regional cultural conventions.
• Run prompts through models, assess preliminary outputs for accuracy, fluency, and cultural appropriateness in Italian, comparing results with English where needed.
• Collaborate in quality assurance review processes to maintain consistency, reliability, and rigor across Italian-language benchmarks.

Qualifications

Must-Have 🔑

• Native-level fluency in Italian (written), with strong reading and writing skills in English, specific to Switzerland or Italy usage.
• Residency or significant experience living in Switzerland or Italy, with deep cultural and linguistic familiarity.
• BS or BA degree from a reputable institution (completed or in progress).
• Strong writing, critical thinking, and independent work skills.
• Experience with ChatGPT or similar AI tools for personal decision-making, hobbies, or interests.

Preferred 🌟

• Background in teaching, research, editing, or academic writing.
• Experience in creating evaluation criteria, rubrics, or grading guidelines.
• Familiarity with large language models (LLMs), prompting, or model evaluation processes.

Application Process (Estimated Time: 20–30 mins)

1. Complete an AI-led interview (~15 minutes).
2. If approved, undertake a paid assessment focused on writing and rubric creation.
3. Successful candidates will be invited to join the project team.

Resources & Support

For detailed information about the interview process and platform, please click here.

If you need any help or support, feel free to reach out to us.

📝 Note: Our team reviews applications daily. Please complete your AI interview and application steps promptly to be considered for this exciting opportunity.

#J-18808-Ljbffr