AI Summary
Recent graduates with data analysis skills or AI training experience are invited to apply for a junior-level role. The position involves working with AI and Machine Learning, and the candidate should have basic exposure to SQL. The role is 100% remote and offers a competitive salary.
Key Highlights
End to End LLM Evaluations and Insight Generation
Rubric writing and LLM prompt development
Scrape data using internal tools
Collect and annotate golden labels
Collaborate on calibrating the quality of our models
Run evaluations on a continuous basis and maintain reporting
Analyze results and generate insights to improve evaluations and the overall process
Serve as the primary liaison between the company and third-party vendor teams
Manage assignments, deadlines, and QA for vendor evaluators
Provide instructions, clarifications, and feedback
Act as the first point of contact for inbound questions related to evaluation tasks
Route questions to the correct stakeholders
Track open items and ensure timely follow-through
Technical Skills Required
Benefits & Perks
Competitive salary: $20.69 per hour
100% remote work
Temporary to permanent role
Job Description
Junior Data Analyst
- 100% remote
- M-F, 40 hours per week
- Note: This is a junior level role – looking for recent grads interested in AI / Machine Learning; need basic exposure to SQL
Pay: $20.69 per hour W2
Duration: ~1 year to start; temp to perm role
- End to End LLM Evaluations and Insight Generation
- Rubric writing and LLM prompt development
- Scrape data using internal tools
- Collect and annotate golden labels
- Collaborate on calibrating the quality of our models
- Run evaluations on a continuous basis and maintain reporting
- Analyze results and generate insights to improve evaluations and the overall process
- Serve as the primary liaison between the company and third-party vendor teams
- Manage assignments, deadlines, and QA for vendor evaluators
- Provide instructions, clarifications, and feedback
- Act as the first point of contact for inbound questions related to evaluation tasks
- Route questions to the correct stakeholders
- Track open items and ensure timely follow-through
Qualifications:
- Background: recent grad with data analysis skills OR candidates with AI training experience
- Skills: Google Sheets + Basic SQL
- Education: high school diploma required; college degree preferred
- Nice to have: experience with prompt engineering