Remote Data Labeling Jobs UK — United States

Rex.zone is hiring for a full-time remote role focused on training-data creation and evaluation for AI/ML systems. You will support production-grade pipelines across NLP, LLM evaluation/RLHF-style workflows, computer vision annotation, and content safety labeling with measurable quality targets and audit-ready documentation.

What You Will Do

• Label and review text, image, and multi-modal datasets using project rubrics and tooling

• Perform QA evaluation on peer outputs, escalate edge cases, and propose guideline clarifications

• Execute prompt evaluation and LLM response rating to generate RLHF-ready preference data

• Conduct content safety labeling (e.g., harassment, self-harm, violence, adult content, regulated goods)

• Track errors, maintain audit trails, and participate in calibration sessions to improve inter-annotator agreement

• Collaborate with operations and engineering partners to refine instructions and reduce ambiguity

Required Qualifications

• Experience delivering professional data labeling or QA evaluation work with documented quality metrics

• Strong reading comprehension and ability to apply complex rubrics consistently

• Familiarity with LLM evaluation concepts (preference ranking, rubric scoring, prompt evaluation)

• Comfort working with annotation tools, structured forms, and versioned guidelines

• Ability to write concise rationales and document difficult cases

Preferred Qualifications

• Exposure to RLHF pipelines and large language model evaluation

• Computer vision annotation (boxes, polygons, keypoints)

• NLP labeling experience including named entity recognition

• Content safety / trust & safety workflow experience

Compensation

Hourly range: $30–$50/hour (USD).

Workplace: Remote

Employment Type: Full-time