Audio Annotator — E-Solutions, United States

Audio Annotator

Remote- US

Full Time

We’re hiring detail-oriented Voice Specialists to evaluate AI models through real-time voice conversations. You’ll run the same scenario with two models, compare their performance, and recommend the stronger one.

What You’ll Do

• Roleplay the same scenario with Model A and Model B, keeping approach and turn count consistent

• Record conversations and score each model across five evaluation dimensions

• Identify and categorize errors in audio or conversation

• Choose the stronger model and write a rationale with specific examples

What You Bring

• Bachelor’s degree

• Strong attention to detail and listening skills

• Clear, objective writing

• Comfort with natural speaking and roleplay

• Analytical thinking and consistency in applying guidelines

• Familiarity with AI assistants or voice AI