Data Scientist - AI Model Evaluation and Improvement

Alignerr United State
Remote
Apply
AI Summary

Join Alignerr as a Data Scientist to evaluate and improve next-generation AI systems. You will design and apply data-driven evaluation criteria, analyze patterns in AI-generated responses, and provide high-quality training data. This is a remote, hourly contract opportunity.

Key Highlights
Evaluate AI model outputs
Design data-driven evaluation criteria
Analyze patterns in AI-generated responses
Key Responsibilities
Evaluate AI model outputs for accuracy
Design and apply data-driven evaluation criteria
Analyze patterns in AI-generated responses
Create high-quality training data
Provide structured, detailed feedback
Review AI-generated code and visualizations
Technical Skills Required
Python R SQL Data wrangling Exploratory data analysis Model evaluation
Benefits & Perks
Fully remote work
Hourly contract
Potential for ongoing work and long-term contract extension
Nice to Have
Experience with deep learning frameworks
Familiarity with NLP, large language models, or AI evaluation workflows
Published research or industry experience in applied machine learning

Job Description


About The Role

We're looking for data scientists based in Germany to help train, evaluate, and improve next-generation AI systems. Your quantitative expertise will directly influence how state-of-the-art AI models reason, analyze, and communicate — making a real and lasting impact on the future of artificial intelligence.

  • Organization: Alignerr
  • Type: Hourly Contract
  • Location: Remote
  • Commitment: 10–40 hours/week

What You'll Do

  • Evaluate AI model outputs for accuracy, reasoning quality, and statistical soundness
  • Design and apply data-driven evaluation criteria and scoring rubrics
  • Analyze patterns in AI-generated responses to identify systematic errors or biases
  • Create high-quality training data including prompts, solutions, and annotations in your areas of expertise
  • Provide structured, detailed feedback to improve model performance across data science and analytical tasks
  • Review AI-generated code, visualizations, and statistical analyses for correctness
  • Work independently and asynchronously on your own schedule

Who You Are

  • Degree in Data Science, Statistics, Computer Science, Mathematics, or a related quantitative field (MS or PhD preferred)
  • Strong foundation in statistics, probability, and machine learning concepts
  • Proficient in Python, R, SQL, or similar data analysis tools
  • Experienced with data wrangling, exploratory data analysis, and model evaluation
  • Excellent analytical thinking with sharp attention to detail
  • Strong written communication in English — able to explain complex technical concepts clearly and simply
  • Self-motivated and comfortable working independently

Nice to Have

  • Experience with deep learning frameworks such as PyTorch or TensorFlow
  • Familiarity with NLP, large language models, or AI evaluation workflows
  • Published research or industry experience in applied machine learning
  • Background in A/B testing, causal inference, or experimental design

Why Join Us

  • Work on cutting-edge AI projects shaping the future of technology
  • Collaborate with top research labs and AI teams around the world
  • Fully remote and flexible — work on your own schedule, on your terms
  • Gain rare, hands-on exposure to how state-of-the-art LLMs are trained and evaluated
  • Be part of a growing community of expert contributors making AI smarter and more reliable
  • Potential for ongoing work and long-term contract extension


Similar Jobs

Explore other opportunities that match your interests

Business Analyst (Technology and System Implementation)

Data Science
8h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

TEKsystems

United State

Entry-Level Analytics Engineer

Data Science
13h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Entry level

adelaide

United State
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Associate

Jobgether

United State

Subscribe our newsletter

New Things Will Always Update Regularly