Crossing Hurdles Is Hiring A Data Analyst

Join our team as a Vietnamese LLM – AI Quality Analyst (Personalization), focusing on enhancing AI response quality through personalization and data evaluation. This role offers a short-term contract suitable for remote work with flexible hours.

Position: LLM – AI Quality Analyst (Personalization) – Vietnamese

Type: Short-Term Contract

Location: Remote

Commitment: Full-time (30–40 hours/week, 4-hour overlap with PST)

Engagement Length: 2 months

Start Date: Immediate

🔍 Role Responsibilities

• Design multi-turn conversational prompts (1–5 turns) leveraging personal context
• Evaluate personalized AI responses for grounding, integration, and helpfulness
• Assess correct usage of personal data and identify flawed inferences or hallucinations
• Review integration quality to ensure personalization feels natural and not over-narrated
• Conduct side-by-side (SxS) evaluation and ranking of model responses
• Identify personalization errors, reasoning gaps, and grounding issues
• Write clear, structured rationales referencing specific conversation turns
• Extract and verify “Debug Info” to ensure correct data source utilization
• Maintain strict data hygiene by deleting evaluation conversations

📝 Requirements

• Vietnamese proficiency (reading and writing)
• Strong experience in data annotation, AI quality evaluation, content moderation, or related roles
• Strong analytical skills for nuanced and ambiguous AI output evaluation
• Experience with creative prompt engineering and multi-turn conversations
• Understanding of personalization concepts and AI response evaluation
• High attention to detail for SxS comparisons
• Excellent written communication and feedback documentation skills
• BS/BA degree or equivalent experience in a relevant field
• Willingness to use a primary personal Google account with enabled personal data sources
• Self-motivated and capable of working independently in a remote setup
• Reliable desktop/laptop with internet connection