AQUENT Is Hiring An Ai Quality Analyst

Exciting Opportunity: AI Quality Analyst for Personalization Feature Evaluation 🚀

Join a dynamic team to evaluate and enhance personalized AI responses, blending creativity with analytical rigor in a remote, full-time role.

Placement & Compensation Details

• Placement Type: N/A
• Salary: $20 Hourly 💵
• Start Date: April 6, 2026
• Engagement Type: Contractor (1 month)
• Work Hours: At least 4 hours per day, 30 hours/week (options for 40 hours/week)
• Overlap: 4 hours with a specific time zone

Role Overview

As an AI Quality Analyst, you will evaluate a new personalization feature for Gemini, assessing how effectively the AI utilizes information from your conversations, Gmail, Google Search, and YouTube activity to generate relevant responses. This role demands a blend of creativity and analytical rigor to design prompts and analyze AI responses.

Key Responsibilities

• Prompt Design: Create multi-turn conversational prompts (1-5 turns) using personal experience to test AI capabilities.
• Response Evaluation: Assess AI responses for personalization accuracy, grounding, and helpfulness.
• Analyzing & Reporting: Identify issues such as Grounding errors, poor Integration, or hallucinations, and provide clear rationales for rankings.
• Comparison & Ranking: Stack-rank two model responses for overall helpfulness, ease, and enjoyment, with detailed annotations.
• Debug & Data Hygiene: Extract "Debug Info" for source verification and delete conversations to maintain data privacy.

Must-Have Qualifications

• Korean Proficiency: High reading and writing skills in Korean, as it is the focus language.
• Analytical Skills: Ability to evaluate nuanced AI responses and personalization quality.
• Creative Prompt Engineering: Experience in designing multi-turn prompts based on personal context.
• Attention to Detail: Spot subtle differences in naturalness and over-narrating between model responses.
• Communication Skills: Write clear, concise rationales with explicit references to conversation turns.
• Technical Setup: Desktop/laptop with reliable internet connection.
• Educational Background: BS/BA degree or equivalent in Policy, Law, Ethics, Linguistics, Journalism, Computer Science, or a related field.
• Availability: Full-time (8 hours/day) with 4 hours overlap in your time zone.
• Work Ethic: Self-motivated, independent, and committed to maintaining strict data hygiene.

Nice-to-Have Qualifications

• Experience in data annotation, AI quality evaluation, content moderation, or related fields.

Additional Offer & Evaluation Process

• Recruitment Process: Submit a Job Interest Form, complete an assessment within 24 hours, then discuss pre-onboarding steps.
• Compensation: $20/hour, based on experience, education, certifications, and location.
• Global & Flexible: Support for a worldwide team with flexible scheduling.

About Skill

Skill connects top talent across tech, engineering, finance, and administration with leading brands, offering benefits like health contributions, retirement plans, and flexible spending accounts. We are an equal-opportunity employer, valuing diversity and inclusion in our workforce. 🌎✨

LI-ES1