💼 Full-Time Position

AI Response Evaluator

🏢
Thoth AI
📍 South Jakarta, Jakarta, Indonesia
📍
Location
South Jakarta, Indonesia
📅
Posted
May 31, 2026
Type
Full-Time
🎯

Full-Time Opportunity: This is a permanent, full-time position with a competitive package and real career growth potential.

Job Description

Job: AI Response Evaluator

Work setting: On-site in Kebayoran Baru, Jakarta Selatan


We are looking for detail-oriented and analytical contributors to support next-generation AI development through human evaluation and annotation. In this role, you will assess and score AI-generated responses based on a combination of objective and subjective criteria, including accuracy, reasoning quality, clarity, safety, relevance, tone, and overall user experience. Your feedback will directly contribute to improving the performance and alignment of advanced AI models.


Responsibilities

  • Evaluate and score AI-generated outputs using provided guidelines
  • Compare multiple model responses and identify the strongest answer
  • Provide concise justification and qualitative feedback
  • Detect factual inaccuracies, hallucinations, bias, or unsafe content
  • Support continuous improvement of annotation standards and workflows
  • Co...