Experienced Software Engineer for AI Research Collaboration

yo hr consultancy • United State
Remote
Apply
AI Summary

Contribute to building evaluation datasets for AI reasoning and explanation quality. Craft realistic developer prompts and write clear, technically accurate model responses. 2+ years of experience in software engineering required.

Key Highlights
Contribute to AI research collaboration
Craft realistic developer prompts
Write clear, technically accurate model responses
Key Responsibilities
Craft realistic developer prompts across multiple categories
Source and adapt content from real PRs to create authentic scenarios
Write clear, technically accurate model responses
Technical Skills Required
Python JavaScript Java C++ Debugging Testing Code review
Benefits & Perks
Part-time (15–25 hours/week) with flexibility up to 40 hours/week
Fully remote role
Independent contractor

Job Description


hiring experienced Software Engineers to support high-impact research collaborations with leading AI labs. Freelancers will contribute to building evaluation datasets that assess AI reasoning, explanation quality, and technical judgment in coding-related interactions.

This is a unique opportunity to apply your engineering expertise toward shaping the next generation of intelligent systems.

About The Project

This evaluation dataset is code question and answer data. This data is designed to assess natural-language reasoning, explanation quality, and technical judgment in coding-related interactions, rather than executable correctness. Tasks are structured as chat-pasteable prompts that reflect realistic developer questions and include all necessary context inline (e.g., code snippets, error messages, logs, or requirements)

Key Responsibilities

  • Craft realistic developer prompts across multiple categories (code review, debugging, error diagnosis, configuration, and more)
  • Source and adapt content from real PRs to create authentic scenarios
  • Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality

Ideal Qualifications

  • 2+ years of experience in software engineering, technical research, or educational content development
  • Degree in Software Engineering, Computer Science, or a related field (Bachelor’s minimum; advanced degree preferred)
  • Strong proficiency in languages like Python, JavaScript, Java, or C++
  • Experience with debugging, testing, and validating code
  • Comfortable with technical writing and attention to detail

Project Timeline

  • Start Date: Immediate
  • Duration: 1-2 months
  • Commitment: Part-time (15–25 hours/week, with flexibility up to 40 hours/week)

Application & Onboarding Process

  • Upload your resume
  • AI interview: A short, 15-minute conversational session to understand your background, experience, and interest in the role
  • Follow-up communication within a few days with next steps and onboarding details

Apply today and leverage your software engineering expertise to help build the future of AI-driven systems!

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request

Contract and Payment Terms

  • You will be engaged as an independent contractor.
  • This is a fully remote role that can be completed on your own schedule.
  • Projects can be extended, shortened, or concluded early depending on needs and performance.

Skills: application,software,debugging,qa,code,code review,testing,automation,software testing

Similar Jobs

Explore other opportunities that match your interests

Senior Manager, Test Engineering

Testing
•
19h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

Storable

United State

Software QA Engineer

Testing
•
1d ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

remotehunter

United State

Automation Tester

Testing
•
1d ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

ICF

United State

Subscribe our newsletter

New Things Will Always Update Regularly