Remote Data Labeling Specialist (Austin)
<strong>Remote Data Labeling Jobs in Austin (Remote)<br><br></strong>Rex.zone is hiring a <strong>Remote Data Labeling Specialist</strong> to produce high-quality training data for AI/ML systems. You will complete data labeling, RLHF preference ranking, QA evaluation audits, prompt evaluation, and content safety labeling to support LLM training pipelines and computer vision workflows.<br><br><strong>What You Will Do<br><br></strong><ul><li>Label and categorize text, images, and multimodal content using web-based annotation tools and strict guidelines</li><li>Perform RLHF work: preference ranking, pairwise comparisons, rubric-based scoring, and rationale documentation</li><li>Execute QA evaluation (sampling, audits, defect tracking) and provide feedback to improve training data quality</li><li>Run prompt evaluation for helpfulness, harmlessness, and factuality within defined policies</li><li>Apply named entity recognition (NER) and span labeling for structured extraction tasks</li><li>Support computer vision annotation (bounding boxes, polygons, segmentation, keypoints) as needed</li><li>Document edge cases and propose guideline clarifications to improve reviewer agreement</li><li>Collaborate with operations and engineering stakeholders to improve throughput without sacrificing quality<br><br></li></ul><strong>Required Qualifications<br><br></strong><ul><li>Mid-Senior experience delivering production data labeling / data annotation</li><li>Strong annotation guideline compliance and consistency across large volumes</li><li>Experience with QA evaluation workflows (error taxonomy, root-cause analysis)</li><li>Familiarity with RLHF and LLM evaluation rubrics</li><li>Clear written communication for rationale and edge-case documentation</li><li>Comfort with web labeling interfaces and review queues<br><br></li></ul><strong>Work Context<br><br></strong><ul><li>Workplace: Remote (Austin is the targeted candidate market; work is performed remotely)</li><li>Employment Type: FULL_TIME</li><li>Domains: NLP, computer vision, content safety, LLM training pipelines<br><br></li></ul><strong>Compensation<br><br></strong>Base pay range: <strong>$30–$50 per hour</strong> (USD).