AI Summary
We are seeking a skilled Software Engineer to create realistic developer prompts and evaluate AI outputs. The ideal candidate will have strong experience in software engineering, technical research, or educational content development. This is a remote, hourly contract position.
Key Highlights
Create realistic developer prompts
Evaluate AI outputs
Collaborate with research teams
Key Responsibilities
Craft realistic, chat-style developer prompts
Source and adapt real pull requests and engineering discussions
Evaluate AI outputs based on logic, clarity, and technical judgment
Technical Skills Required
Benefits & Perks
Hourly compensation $70-$120
Remote work
Flexible hours (10-40 hours/week)
Job Description
Position: Software Engineer – Code QA
Type: Hourly contract
Compensation: $70–$120/hour
Location: Remote
Commitment: 10–40 hours/week
Role Responsibilities
- Craft realistic, chat-style developer prompts covering code review, debugging, error diagnosis, configuration, and related scenarios.
- Source and adapt real pull requests and engineering discussions to create authentic evaluation tasks.
- Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality.
- Evaluate AI outputs based on logic, clarity, and technical judgment rather than executable correctness.
- Apply software engineering expertise to ensure prompts and responses reflect real-world developer workflows.
- Contribute to structured evaluation datasets used to assess AI reasoning and communication quality.
- Collaborate asynchronously with research teams to refine task quality and consistency.
Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.
- Strong experience in software engineering, technical research, or educational content development.
- Bachelor’s degree in Software Engineering, Computer Science, or a related field.
- Strong proficiency in one or more languages such as Python, JavaScript, Java, or C++.
- Hands-on experience with debugging, testing, and validating code.
- Strong technical writing skills with high attention to detail.
- Ability to work independently in a fully remote, project-based environment.
Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.
- Upload resume
- Interview (15 min)
- Submit form
Similar Jobs
Explore other opportunities that match your interests
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Mid-Senior level
SearchWorks
United Kingdom
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Internship
joinrs
United Kingdom
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Mid-Senior level
montu uk
United Kingdom