AI Summary
Design and evaluate realistic code review and debugging scenarios for AI systems. Develop authentic pull requests and responses. Collaborate with research teams to refine tasks. Requires software engineering expertise and technical writing skills.
Key Highlights
Designing chat-style developer prompts for code review and debugging
Evaluating AI outputs based on logic and technical judgment
Contributing to structured datasets for AI assessment
Key Responsibilities
Craft realistic, chat-style developer prompts covering code review, debugging, error diagnosis, configuration, and related scenarios.
Source and adapt real pull requests and engineering discussions to create authentic evaluation tasks.
Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality.
Evaluate AI outputs based on logic, clarity, and technical judgment rather than executable correctness.
Apply software engineering expertise to ensure prompts and responses reflect real-world developer workflows.
Contribute to structured evaluation datasets used to assess AI reasoning and communication quality.
Collaborate asynchronously with research teams to refine task quality and consistency.
Technical Skills Required
Benefits & Perks
Remote work
Job Description
Position: Software Engineer – Code QA
Type: Hourly contract
Compensation: $70–$120/hour
Location: Remote
Commitment: 10–40 hours/week
Role Responsibilities
- Craft realistic, chat-style developer prompts covering code review, debugging, error diagnosis, configuration, and related scenarios.
- Source and adapt real pull requests and engineering discussions to create authentic evaluation tasks.
- Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality.
- Evaluate AI outputs based on logic, clarity, and technical judgment rather than executable correctness.
- Apply software engineering expertise to ensure prompts and responses reflect real-world developer workflows.
- Contribute to structured evaluation datasets used to assess AI reasoning and communication quality.
- Collaborate asynchronously with research teams to refine task quality and consistency.
Interested in remote work opportunities in QA & Testing? Discover QA & Testing Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.
- Strong experience in software engineering, technical research, or educational content development.
- Bachelor’s degree in Software Engineering, Computer Science, or a related field.
- Strong proficiency in one or more languages such as Python, JavaScript, Java, or C++.
- Hands-on experience with debugging, testing, and validating code.
- Strong technical writing skills with high attention to detail.
- Ability to work independently in a fully remote, project-based environment.
Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.
- Upload resume
- Interview (15 min)
- Submit form
Similar Jobs
Explore other opportunities that match your interests
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Mid-Senior level
Jobs via Dice
United State
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Mid-Senior level
Jobs via Dice
United State
Visa Sponsorship
Relocation
Remote
Job Type
Contract
Experience Level
Associate
Kforce Inc
United State