Crossing Hurdles Is Hiring An Ai Content Moderator

We are seeking a detail-oriented AI Quality Analyst specializing in Personalization for Polish language to ensure the highest standards of AI response quality and relevance. This role offers flexible, remote short-term engagement with immediate start.

🚀 Job Opportunity: LLM – AI Quality Analyst (Personalization) – Polish

🔍 Position Details

• Type: Short-Term Contract
• Location: Remote (Global)
• Commitment: 20-40 hours/week with 4 hours overlap with PST
• Engagement Length: 1 month
• Start Date: Immediate

🎯 Role Responsibilities

• Design multi-turn conversational prompts based on personal context 🤖
• Evaluate personalized AI responses for relevance, grounding, and helpfulness ✅
• Assess correct and incorrect use of personal data in model outputs 🛡️
• Perform side-by-side (SxS) evaluation and ranking of AI responses 🔢
• Identify grounding errors, poor inferences, and forced personalization ⚠️
• Write clear, structured rationales referencing specific conversation turns ✍️
• Extract and verify model debug information and data source usage 🧩
• Maintain strict data hygiene by deleting evaluation conversations 🗑️

🔑 Requirements

• Polish fluency (reading and writing) is mandatory 📝
• Experience in data annotation, AI quality evaluation, content moderation, or related roles highly preferred ⭐
• Strong analytical thinking and attention to detail 🔍
• Ability to evaluate nuanced and ambiguous AI responses 🤔
• Comfortable using a personal Google account with enabled data sources 🌐
• BS/BA degree or equivalent experience in a relevant analytical field 🎓
• Strong written communication and structured feedback skills 💬
• Self-motivated with the ability to work independently remotely 🚀
• Reliable desktop/laptop with stable internet connection 💻🌐