Senior Data Annotation Jobs in Miami — Miami, FL

Senior Data Annotation Jobs in Miami (Remote)

Join Rex.zone to lead and execute high-quality data annotation and evaluation work that improves AI/ML model behavior across modern LLM training pipelines. You will help ensure training data quality through strong annotation guidelines compliance, RLHF preference ranking, prompt evaluation, and rigorous QA evaluation loops.

Key Responsibilities

• Own annotation guidelines compliance and refine rubrics for high-agreement labeling

• Perform RLHF tasks including preference ranking, justification writing, and edge-case adjudication

• Execute prompt evaluation and response grading across safety, factuality, instruction-following, and style

• Run QA evaluation workflows: sampling plans, error taxonomies, inter-annotator agreement checks, and corrective actions

• Support named entity recognition and information extraction labeling for NLP datasets

• Deliver computer vision annotation as needed (bounding boxes, polygons, keypoints, segmentation masks)

• Perform content safety labeling (toxicity, harassment, self-harm, sexual content, violence)

• Partner with engineering to improve tooling, audits, and scalable labeling pipelines

• Document decisions and escalate ambiguous cases to maintain consistency

Required Qualifications

• Mid-Senior experience in data annotation, data labeling, or AI/ML evaluation programs

• Strong understanding of training data quality and how labels affect model behavior

• Demonstrated QA evaluation experience (sampling, calibration, agreement measurement, error analysis)

• Experience in at least one domain: NLP/NER, LLM evaluation (prompt evaluation/RLHF), computer vision annotation, or content safety labeling

• Clear written communication and comfort working in remote, metrics-driven environments

Work Model & Location

Remote-first role targeting the Miami, Florida talent market with full-time availability and overlap for reviews and calibration sessions.

Pay: $30–$50 per hour (base salary).