Crossing Hurdles Is Hiring A Generalist

Join our team as an LLM - AI Quality Analyst for Personalization (Italian)! This remote, hourly position offers flexible hours and an exciting opportunity to work on cutting-edge AI models.

🔍 Position Details

• Position: LLM - AI Quality Analyst Personalization - Italian
• Type: Hourly contract
• Compensation: $11 - $15/hour
• Location: Remote
• Commitment: 30–40 hours/week

🎯 Role Responsibilities

• Assess AI responses for personalization quality: including grounding, integration, and helpfulness.

• Design and execute multi-turn prompts: based on personal context to test AI capabilities.

• Analyze responses: for hallucinations, incorrect personalization, and flawed inferences.

• Perform side‑by‑side (SxS) comparisons: of model outputs to evaluate quality and effectiveness.

• Write clear and structured rationales: for response evaluations and rankings.

• Provide detailed feedback and annotations: to help improve AI model performance.

• Maintain strict data hygiene: and ensure accurate documentation of evaluations.

📝 Requirements

• Proficiency in Italian: Excellent reading and writing skills.

• Experience: Data annotation, AI evaluation, content moderation, or related roles.

• Strong analytical skills: Ability to evaluate nuanced AI responses.

• Creativity in prompt design: Ability to craft multi-turn prompts based on personal context.

• Excellent communication and attention to detail:

• Full-time availability: Flexibility and ability to overlap with PST time zone.

• Educational Qualifications: Bachelor's degree or equivalent experience in a relevant analytical field.