Automated CS Planning QA Reviewer — Zion (Arches)

Mercor Australia
Remote
Apply
AI Summary

Review and quality-check symbolic-AI and automated-planning problems authored by domain experts. Verify correctness, technical rigor, and clarity of data used to train and evaluate state-of-the-art large language models. Conduct multiple independent reviews to ensure accuracy and depth while collaborating with domain experts.

Key Highlights
PhD or advanced degree in Computer Science, AI, ML, or Operations Research required
Hourly compensation of $55–$80 for contract QA review work
Remote position with asynchronous, independent work
Multiple independent reviews per problem to ensure accuracy
Key Responsibilities
Review and quality-check challenging symbolic-AI and automated-planning problems authored by domain experts
Verify correctness, technical rigor, and clarity of data used to train and evaluate state-of-the-art large language models
Conduct multiple independent reviews for each problem to ensure accuracy and depth
Collaborate with domain experts to maintain high standards in problem-solving and model evaluation
Work independently and asynchronously to meet deadlines and improve AI model performance
Technical Skills Required
Computer Science Artificial Intelligence Machine Learning Operations Research
Benefits & Perks
Remote work
Hourly compensation of $55–$80

Job Description


About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Automated CS Planning QA Reviewers — Zion (Arches)

Type: Contract

Compensation: $55–$80/hour

Location: Remote

Role Responsibilities

  • Review and quality-check challenging symbolic-AI and automated-planning problems authored by domain experts.
  • Verify correctness, technical rigor, and clarity of data used to train and evaluate state-of-the-art large language models.
  • Conduct multiple independent reviews for each problem to ensure accuracy and depth.
  • Collaborate with domain experts to maintain high standards in problem-solving and model evaluation.
  • Work independently and asynchronously to meet deadlines and improve AI model performance.


Qualifications

Must-Have

  • PhD or advanced degree in Computer Science, Artificial Intelligence, Machine Learning, or Operations Research.
  • Strong reviewing / QA instincts to verify problem correctness and solutions.
  • High attention to detail.
  • Exceptional written and verbal communication skills.


Start Date

  • Applications reviewed on a rolling basis.


Interview Process

  • Complete a short interview and task (20–30 mins).
  • Paid for up to 1 hour of onboarding time, including onboarding videos if hired.


Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form


Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com


PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Similar Jobs

Explore other opportunities that match your interests

Senior Manager, Global Payroll Compliance & International Operations

Hr
4d ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Figma

Australia
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

Jobgether

Australia

Global Payroll Specialist Lead

Hr
2w ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Remote

Australia

Subscribe our newsletter

New Things Will Always Update Regularly