Mercor Is Hiring A Remote Cantonese Audio Generalist Evaluator Expert

Join Mercor as a Cantonese Audio Generalist Evaluator Expert! 🎧📊

Mercor is looking for a skilled Cantonese Audio Generalist Evaluator Expert to contribute to an innovative audio AI research project alongside a leading research lab. If you're passionate about language, technology, and precise data annotation, this role offers a short-term, structured opportunity to make a meaningful impact in the field of AI.

🌟 About the Role

In this role, you'll handle transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. The position is ideal for candidates with strong academic or analytical backgrounds who are fluent in Cantonese and English and enjoy translating complex audio and visual information into clear, well-structured text.

📝 Responsibilities

• Transcribe and Optimize Audio & Video
  • Listen to, analyze, and transcribe audio and video content in Cantonese following detailed constraints and instructions.
  • Produce high-quality written outputs, supporting with English when needed.
  • Ensure clarity, accuracy, and adherence to formatting and stylistic guidelines.
• Define and Document Evaluation Standards
  • Set clear expectations for accurate responses in consumer audio contexts.
  • Develop detailed evaluation rubrics and grading guidelines in Cantonese and English.
  • Document standards to maintain consistency across reviewers and models.
• Conduct Model Testing and Grading
  • Run prompts through language models and assess generated outputs.
  • Evaluate responses based on accuracy, completeness, and clarity.
• Support Benchmarking and Quality Assurance
  • Participate in QA and review cycles to uphold quality standards.
  • Ensure dataset reliability before integration into official benchmarks.
  • Collaborate with project leads to resolve ambiguities and enhance task design.

🎓 Minimum Qualifications

• Strong writing, editing, and critical thinking skills
• Ability to work independently, manage time effectively, and meet deadlines
• Fluency in Cantonese and English (spoken and written)
• Availability to commit 10–20 hours per week

✨ Preferred Qualifications

• College students or recent graduates
• Background in linguistics, humanities, social sciences, or technical fields
• Experience with transcription, annotation, evaluation, or research workflows
• Interest in AI, language models, or applied research environments

🔍 Additional Role Details

Join a structured, goal-oriented project environment with clear tooling, guidelines, and support. Gain hands-on exposure to real-world AI research and evaluation workflows, enhancing your skills in a dynamic tech setting.