Remote Data Annotator Jobs in Phoenix
About The Role Remote data annotator jobs in Phoenix at Rex.zone focus on producing high-quality training data for AI systems across NLP, computer vision, and LLM training pipelines. You will perform data labeling, RLHF-based preference ranking, prompt evaluation, and QA evaluation to improve model performance and training data quality.
What You Will Do
- Label data for NLP tasks such as text classification, intent, sentiment, toxicity, and named entity recognition
- Perform large language model evaluation by scoring relevance, factuality, completeness, instruction-following, and safety
- Execute RLHF-style preference ranking by comparing and ranking model outputs
- Annotate computer vision data using bounding boxes, polygons, keypoints, and segmentation
- Complete QA evaluation using audits, inter-annotator agreement targets, and rework when needed
- Follow annotation guidelines compliance, document edge cases, and support calibration sessions
Requirements
- Strong written English and attention to detail
- Ability to follow complex guidelines and self-audit work for consistency and accuracy
- Preferred: experience with data labeling tools, prompt evaluation, content safety labeling, or QA processes
Work Model This is a full-time Remote role performed online with secure workflows. Open to candidates in the US, including Phoenix-based applicants. Apply To This Job