Job Description
AI Jobs in Canada (Remote, Full-Time) — Open Role
Rex.zone supports distributed AI/ML data operations that improve large language model evaluation and training data quality. This role focuses on production-grade workflows such as RLHF, data labeling, prompt evaluation, QA evaluation, and content safety labeling across NLP and (optionally) computer vision.
What You Will Do
- Execute RLHF evaluation, preference ranking, and rubric-based rationales
- Perform prompt evaluation and response grading (helpfulness/harmlessness/honesty)
- Complete data labeling tasks including named entity recognition and text classification
- Run QA evaluation via audits, spot checks, and inter-annotator agreement workflows
- Apply content safety labeling policies and maintain annotation guidelines compliance
- Document edge cases and surface systematic failure modes impacting LLM training pipelines