AI Dialogue & Tone Evaluator

About the Role

We’re looking for an AI Dialogue & Tone Evaluator to help fine-tune AI communication so it sounds authentically human. You’ll review, tag, and improve AI-generated responses — ensuring the right balance of empathy, cultural awareness, and clarity.

Responsibilities

• Compare multiple AI response options and select the most human-like
• Tag tone and personality issues using a structured rubric
• Write short sample prompts in specific styles and emotional tones
• Recognize and interpret cultural references, humor, and character archetypes
• Collaborate with other evaluators to keep scoring consistent

Requirements

• Native or near-native US English fluency
• Exceptional reading comprehension and attention to subtle tone shifts
• Strong awareness of emotional cues and conversational flow
• Familiarity with US pop culture, media, and humor styles

Preferred Background

• Content moderation, copyediting, or customer communications
• Journalism, creative writing, or psychology
• Familiarity with AI chat tools or evaluation