Crossing Hurdles Is Hiring A Quality Specialist

Join our team as an LLM – AI Quality Analyst (Personalization) – Polish and play a vital role in enhancing AI-driven personalization through detailed evaluation and analysis. This is a short-term remote opportunity suitable for individuals fluent in Polish, with a focus on ensuring AI responses are relevant, accurate, and helpful.

Position Overview

Type: Short-Term Contract

Location: Remote (Global)

Commitment: 20-40 hours/week with 4 hours overlap with PST

Engagement Length: 1 month

Start Date: Immediate

Role Responsibilities

• Design multi-turn conversational prompts based on personal context 📝
• Evaluate personalized AI responses for relevance, grounding, and helpfulness ✅
• Assess correct and incorrect use of personal data in model outputs 🔍
• Perform side-by-side (SxS) evaluation and ranking of AI responses 📊
• Identify grounding errors, poor inferences, and forced personalization ⚠️
• Write clear, structured rationales referencing specific conversation turns ✍️
• Extract and verify model debug information and data source usage 🖥️
• Maintain strict data hygiene by deleting evaluation conversations 🧹

Requirements

• Polish fluency (reading and writing) is mandatory — Polish is the focus language for this project 🇵🇱
• Experience in data annotation, AI quality evaluation, content moderation, or related roles is strongly preferred 💼
• Strong analytical thinking and attention to detail 🔬
• Ability to evaluate nuanced and ambiguous AI responses 🤔
• Comfortable using a primary personal Google account with enabled data sources 📱
• BS/BA degree or equivalent experience in a relevant analytical field 🎓
• Strong written communication and structured feedback skills 💬
• Self-motivated, independent worker in a remote environment 🚀
• Reliable desktop/laptop with stable internet connection 💻🌐