Remote AI Data Annotation Specialist (Miami)
Rex.zone is hiring a full-time, fully remote AI Data Annotation Specialist supporting training data creation for modern AI/ML systems. You will label and review text, images, audio, and video to improve LLM evaluation, RLHF feedback quality, and computer vision annotation accuracy while maintaining strong annotation guidelines compliance and training data quality.
Key Responsibilities
- Annotate and review text datasets for NLP tasks such as classification and named entity recognition
- Perform RLHF tasks including preference ranking and rubric-based scoring
- Conduct prompt evaluation and QA evaluation to identify edge cases, label noise, and guideline gaps
- Label computer vision data (bounding boxes, polygons, keypoints, segmentation masks) and validate accuracy
- Apply content safety labeling and policy-based moderation labels for sensitive content categories
- Document decisions, propose improvements to annotation guidelines, and support calibration sessions
- Track quality metrics (disagreement rates, audit pass rates) and contribute to training data quality initiatives
Required Qualifications
- Mid-Senior experience in AI data annotation, data labeling, or QA evaluation/data operations
- Familiarity with LLM evaluation concepts, RLHF workflows, and rubric-based scoring
- Strong written communication and ability to justify labeling decisions with clear rationale
- High attention to detail and consistent annotation guidelines compliance
- Comfort working remotely in a metrics-driven production environment with iterative feedback
Compensation
Hourly base pay range: $30–$50/hr (USD). Remote Type: Remote (Miami-based search intent; eligible across the US). How To Apply Apply via Rex.zone and be prepared to summarize your experience across NLP labeling, computer vision annotation, RLHF, prompt evaluation, and QA evaluation.