Mercor Is Hiring A Remote Cantonese Audio Generalist Evaluator Expert

Join Mercor as a Cantonese Audio Generalist Evaluator Expert 🎙️

Mercor is seeking a skilled Cantonese Audio Generalist Evaluator to contribute to a high-impact audio AI research project. This role offers an exciting opportunity to work on transcription, annotation, and evaluation tasks that help advance language models — perfect for candidates with strong analytical backgrounds who are fluent in Cantonese and English.

Responsibilities

• Transcribe and Optimize Audio & Video
• Listen to, analyze, and transcribe audio and video content in Cantonese following detailed constraints and instructions.
• Produce high-quality written outputs, supporting with English when necessary.
• Maintain clarity, accuracy, and adhere strictly to formatting and stylistic guidelines.
• Define and Document Evaluation Standards
• Establish clear expectations for accurate responses in consumer audio contexts.
• Develop detailed rubrics and grading guidelines in Cantonese and English.
• Document standards to ensure consistency across reviewers and evaluations.
• Conduct Model Testing and Grading
• Run prompts through language models and evaluate generated outputs.
• Assess responses based on criteria such as accuracy, completeness, and clarity.
• Support Benchmarking and Quality Assurance
• Participate in QA cycles to ensure quality standards are met.
• Maintain consistency and reliability before datasets are used in official benchmarks.
• Collaborate with project leads to resolve ambiguities and improve task design.

Minimum Qualifications

• Strong writing, editing, and critical thinking abilities
• Ability to work independently, manage time, and meet deadlines
• Fluency in Cantonese and English (spoken and written)
• Availability for 10–20 hours per week

Preferred Qualifications

• College students or recent graduates
• Background in linguistics, humanities, social sciences, or technical fields
• Experience with transcription, annotation, evaluation, or research workflows
• Interest in AI, language models, or applied research environments

Additional Role Details 🚀

Work within a structured, goal-oriented project environment equipped with clear tools, guidelines, and support. Gain hands-on experience in real-world AI research and evaluation workflows for a rewarding career development opportunity.