Crossing Hurdles Is Hiring A Generalist

Join our team as a LLM - AI Quality Analyst for Personalization in Italian, where you'll play a key role in enhancing AI models' understanding and responsiveness through detailed evaluation and feedback.

Position: LLM - AI Quality Analyst Personalization - Italian

• Type: Hourly contract
• Compensation: $11 - $15/hour
• Location: Remote
• Commitment: 30–40 hours/week

🎯 Role Responsibilities

• Evaluate AI model responses: Assess personalization quality, grounded responses, integration, and helpfulness.
• Design & test prompts: Create multi-turn prompts based on personal context to evaluate AI capabilities.
• Analyze responses: Identify hallucinations, incorrect personalizations, and flawed inferences.
• Compare outputs: Conduct side-by-side (SxS) comparisons to gauge quality and effectiveness.
• Document evaluations: Write clear, structured rationales for response rankings and provide detailed feedback and annotations for model improvements.
• Data hygiene & documentation: Maintain high standards of data accuracy and meticulous record-keeping.

📝 Requirements

• Language proficiency: Strong skills in Italian, both reading and writing.
• Experience: Background in data annotation, AI evaluation, content moderation, or similar roles.
• Analytical skills: Ability to evaluate nuanced AI responses with critical thinking.
• Creativity: Skilled in designing engaging multi-turn prompts based on personal context.
• Communication: Excellent written communication with keen attention to detail.
• Availability: Full-time, flexible hours, with overlap into PST time zone.
• Education: Bachelor's degree or equivalent experience in a relevant analytical field.

🚀 If you're passionate about AI quality and personalization, and meet these requirements, we'd love to hear from you!