Expert Talent Pool Feedback and Alignment
Clera
Key skills
- Data Annotation
- Mathematics
About the Role
Join a remote expert network as a senior rater and reviewer, evaluating complex AI model outputs and helping calibrate other graders. Your work supports the development of high-quality, trustworthy AI systems across specialized fields.
What You'll Do
- Rank and rate expert-level model answers using detailed rubrics and write clear rationales.
- Evaluate steps in model reasoning across fields such as mathematics, coding, law, medicine, and finance.
- Fact-check complex claims against primary sources and verify accuracy.
- Assess answers against content policies, style guides, and edge cases.
- Review other raters' work, calibrate standards, and develop or refine grading guidelines.
- Assess search relevance and provide feedback in live sessions.
What We're Looking For
- At least 5 years of professional experience in rating, review, editing, fact-checking, trust and safety, or a relevant professional domain.
- Native or near-native written English proficiency.
- Experience grading or reviewing expert-level answers against rubrics, policies, or style guides.
- Experience leading or reviewing other raters, such as as a QA lead, rubric owner, or reviewer of reviewers.
- An advanced degree, professional license, or deep working expertise in the domain you grade.
- Hands-on AI data annotation experience, search-quality rating, or experience writing and maintaining grader guidelines is a plus.
Compensation & Benefits
Compensation is $50 to $120 per hour, depending on the project, field, and expertise level. Payment is based on hours worked.
Location
Fully remote. Projects typically run from one week to several months.
Please mention the word UPLIFTING and tag RNTIuMTYxLjE0Ljgz when applying to show you read the job post completely (#RNTIuMTYxLjE0Ljgz). This is a beta feature to avoid spam applicants. Companies can search these words to find applicants that read this and see they're human.
Similar jobs
Human Resources Expert
$50/hr
Remote · via AfterQuery
RemoteContractHuman Resources- Compliance
Photographer
$21–$35/hr
United States · via micro1
RemoteContractArts & Design- Photography
- Data Annotation
- Graphic Design
Clera · Remote (worldwide) · via Himalayas
RemoteFull-timeHuman Resources- Data Annotation
- Mathematics
- Teaching
G2i · Remote (worldwide) · via Himalayas
RemoteFull-timeSoftware Engineering- LLMs
Lio · Munich Office · via Arbeitnow
On-siteFull-timeHuman Resources- Sales
- Research
OPERATIONS RESEARCH ANALYST (WORKFORCE RESEARCH & ANALYSIS)
$132,751–$172,578/yr
Defense Counterintelligence and Security Agency · Multiple Locations · via USAJOBS
HybridFull-timeBusiness Operations- Mathematics
- Statistics
- Data Analysis
Generalist for Data Annotation
$21–$35/hr
Remote · via micro1
RemoteContractData Analysis- Data Annotation
- Machine Learning
- Computer Vision
Video Data Annotator
$8–$10/hr
Remote · via micro1
RemoteContractData Analysis- Data Annotation
- QA Testing
Recruiting Coordinator
$114,000,000–$140,000,000/yr
Pebl · Remote · via Remote OK
RemoteFull-timeHuman Resources- Recruiting
- Compliance
- Research
AI Content Reviewer Video Annotation
$80,000–$90,000/yr
iMerit · Remote · via Remote OK
RemoteFull-timeSoftware Engineering- Data Annotation
Partner Operations Manager
$80,000–$100,000/yr
Mecka · Remote · via Remote OK
RemoteFull-timeBusiness Operations- Recruiting
- Data Annotation
- Project Management
Commercial Metals Company · Remote — United States · via Himalayas
RemoteFull-timeHuman Resources- Recruiting
- Excel
- Fluent Spanish
TTM Technologies · Remote — United States · via Himalayas
RemoteFull-timeHuman Resources- Recruiting
- Project Management
- Electrical Engineering
United Media · London, England, United Kingdom · via Arbeitnow
On-siteFull-timeHuman Resources- Recruiting

