AI Summary
Mercor seeks a Systems Engineer to evaluate frontier AI coding agents on complex engineering tasks. The role involves reviewing model-generated code, architecture decisions, and systems implementations while identifying bugs and performance bottlenecks. Candidates must have 2+ years of systems engineering experience and regular use of AI coding tools.
Key Highlights
Frontier AI coding agents evaluation for complex engineering tasks
Review model-generated code, architecture decisions, and systems implementations
Identify bugs, edge cases, performance bottlenecks, and failure modes
Key Responsibilities
Use frontier AI coding agents to complete and evaluate complex engineering tasks
Review model-generated code, architecture decisions, and systems implementations
Identify bugs, edge cases, performance bottlenecks, and failure modes
Compare outputs from multiple frontier models and assess their strengths and weaknesses
Apply professional engineering judgment to realistic systems engineering scenarios
Work independently and asynchronously to meet deadlines while improving AI model performance
Technical Skills Required
Benefits & Perks
Remote work
Nice to Have
Experience building highly scalable and performance-critical systems
Job Description
About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Systems Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex engineering tasks.
- Review model-generated code, architecture decisions, and systems implementations.
- Identify bugs, edge cases, performance bottlenecks, and failure modes.
- Compare outputs from multiple frontier models and assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic systems engineering scenarios.
- Work independently and asynchronously to meet deadlines while improving AI model performance.
Interested in remote work opportunities in Human Resource? Discover Human Resource Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.
Must-Have
- 2+ years of professional systems engineering experience.
- Experience with distributed systems, networking, operating systems, storage systems, infrastructure software, or database internals.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated systems designs and implementations.
- Experience building highly scalable and performance-critical systems.
- $400 per accepted task
- Compensation is tied to accepted work.
Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.
- Upload resume
- AI interview based on your resume
- Submit form
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
- For any help or support, reach out to: support@mercor.com
Similar Jobs
Explore other opportunities that match your interests
Payroll Specialist
••••••
••••••
••••••
Job Type
••••••
Experience Level
••••••
GE Aerospace
United State
Senior People Business Partner - Go-To-Market Organization
••••••
••••••
••••••
Job Type
••••••
Experience Level
••••••
sundayy
United State
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Mid-Senior level
National Quality Systems
United State