💼 Full-Time Position

ML Evaluation Designer - Expert

🏢
Mercor
📍 Dublin, County Dublin, Ireland
📍
Location
Dublin, Ireland
📅
Posted
June 18, 2026
Type
Full-Time
🎯

Full-Time Opportunity: This is a permanent, full-time position with a competitive package and real career growth potential.

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Code-Data Eval Author — Machine Learning Engineer
Type: Contract
Compensation: $45–$140/hour
Location: Remote
Commitment: 30+ hours/week

Role Responsibilities

  • Design ML/LLM evaluation tasks, rubrics, and metrics to enhance model performance.
  • Grade model/agent outputs and improve evaluation quality through thorough review.
  • Apply training-side judgment...