Senior Technical Reviewer for AI-Generated Code

crossing hurdles โ€ข United Kingdom
Remote
Apply
AI Summary

Evaluate LLM-generated responses to technical questions, validate accuracy, and provide actionable feedback to improve AI model performance. Strong academic and professional background in computer science required. Excellent written communication skills and attention to detail necessary.

Key Highlights
Evaluate LLM-generated responses
Validate technical accuracy
Provide actionable feedback
Key Responsibilities
Evaluate LLM-generated responses to software engineering, data science, and systems design questions
Validate technical accuracy by reviewing reasoning, explanations, and generated code
Execute and test code to confirm correctness and expected outputs
Technical Skills Required
Python Java C++ JavaScript Go Rust SQL Bash
Benefits & Perks
$60-$100/hour
Remote work
Flexible hours

Job Description


Position: Software Engineering, Data Science, and Systems Design Experts

Type: Hourly contract

Compensation: $60โ€“$100/hour

Location: Remote

Commitment: 10โ€“40 hours/week


Role Responsibilities

  • Evaluate LLM-generated responses to software engineering, data science, and systems design questions.
  • Validate technical accuracy by reviewing reasoning, explanations, and generated code.
  • Execute and test code to confirm correctness and expected outputs.
  • Identify logical flaws, inefficiencies, edge cases, and misleading explanations.
  • Assess code quality, readability, algorithmic soundness, and system design choices.
  • Apply structured evaluation frameworks, benchmarks, and taxonomies.
  • Provide clear, actionable annotations to improve AI model performance.
  • Ensure outputs align with real-world engineering best practices and conversational standards.


Requirements

  • Strong academic background in computer science or a closely related discipline.
  • Strong professional background in software engineering, data science, or systems design.
  • Expertise in at least two programming languages (e.g., Python, Java, C++, JavaScript, Go, Rust, SQL, Bash).
  • Strong problem-solving ability and comfort evaluating complex technical reasoning.
  • Excellent written communication skills and attention to detail.
  • Ability to work independently in a fully remote environment.


Application Process (Takes 20 Mins)

  • Upload resume
  • Interview (15 min)
  • Submit form

Similar Jobs

Explore other opportunities that match your interests

Software Engineer - Code QA Specialist

Programming
โ€ข
2h ago
Visa Sponsorship Relocation Remote
Job Type Contract
Experience Level Associate

crossing hurdles

United Kingdom

Angular Developer (Mid-Senior)

Programming
โ€ข
3h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

SearchWorks

United Kingdom

Junior Web Developer

Programming
โ€ข
9h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Internship

joinrs

United Kingdom

Subscribe our newsletter

New Things Will Always Update Regularly