Software Engineer - Code QA Specialist

Remote
Apply
AI Summary

Develop realistic chat-style developer prompts, source and adapt real pull requests, and evaluate AI outputs based on logic and technical judgment. Requires strong software engineering expertise and proficiency in one or more programming languages. Work independently in a fully remote environment.

Key Highlights
Realistic chat-style developer prompts
Source and adapt real pull requests
Evaluate AI outputs based on logic and technical judgment
Key Responsibilities
Craft realistic, chat-style developer prompts
Source and adapt real pull requests and engineering discussions
Write clear, technically accurate model responses
Evaluate AI outputs based on logic, clarity, and technical judgment
Contribute to structured evaluation datasets
Collaborate asynchronously with research teams
Technical Skills Required
Python JavaScript Java C++ Software engineering Technical research Educational content development
Benefits & Perks
Remote work
$70-$120/hour compensation
10-40 hours/week commitment

Job Description


Position: Software Engineer – Code QA

Type: Hourly contract

Compensation: $70–$120/hour

Location: Remote

Commitment: 10–40 hours/week


Role Responsibilities

  • Craft realistic, chat-style developer prompts covering code review, debugging, error diagnosis, configuration, and related scenarios.
  • Source and adapt real pull requests and engineering discussions to create authentic evaluation tasks.
  • Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality.
  • Evaluate AI outputs based on logic, clarity, and technical judgment rather than executable correctness.
  • Apply software engineering expertise to ensure prompts and responses reflect real-world developer workflows.
  • Contribute to structured evaluation datasets used to assess AI reasoning and communication quality.
  • Collaborate asynchronously with research teams to refine task quality and consistency.


Requirements

  • Strong experience in software engineering, technical research, or educational content development.
  • Bachelor’s degree in Software Engineering, Computer Science, or a related field.
  • Strong proficiency in one or more languages such as Python, JavaScript, Java, or C++.
  • Hands-on experience with debugging, testing, and validating code.
  • Strong technical writing skills with high attention to detail.
  • Ability to work independently in a fully remote, project-based environment.


Application Process (Takes 20 Min)

  • Upload resume
  • Interview (15 min)
  • Submit form

Similar Jobs

Explore other opportunities that match your interests

Senior Embedded Firmware Engineer

Programming
30m ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

fullstack

Canada
Visa Sponsorship Relocation Remote
Job Type Contract
Experience Level Not Applicable

keystone recruitment

Canada

Full Stack Software Engineer - Platform Prototyping & Innovation

Programming
9h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

NEARSOURCE TECHNOLOGIES

Canada

Subscribe our newsletter

New Things Will Always Update Regularly