Data Analyst - AI Product Team

medvidi • Poland
Remote
Apply
AI Summary

Join MEDvidi's AI product team as a Data Analyst to ensure data-driven accuracy in decision-making and evaluate the impact of AI agents and LLM-based systems. Analyze performance, design dashboards, and identify opportunities for automation. Work closely with Product, Engineering, and QA teams to support data-informed decisions.

Key Highlights
Analyze AI initiative performance
Design and implement evaluation approaches
Partner with cross-functional teams
Key Responsibilities
Analyze performance and impact of AI initiatives
Develop and maintain dashboards
Investigate issues and inconsistencies
Technical Skills Required
Python SQL Tableau
Benefits & Perks
Health insurance
Sports & wellness compensation
Fully remote work
Nice to Have
Experience evaluating AI/ML/LLM products
Understanding of model quality metrics and evaluation approaches

Job Description


At MEDvidi, we are transforming mental healthcare by making it more accessible and affordable across the United States. Our mission is to remove barriers to mental health support and ensure that everyone can access the care they need.

As our AI initiatives scale, high-quality analytics becomes a critical bottleneck - and this role is designed to solve it.

About The Role

We are hiring a Data Analyst to play a key role within the AI product team, ensuring data-driven accuracy in decision-making while evaluating, improving, and scaling AI-powered solutions in production.

This is a highly strategic, fast-paced role focused on measuring the real impact of AI agents and LLM-based systems, turning ambiguous problems and incomplete data into accurate decisions

Requirements:

  • 3+ years of hands-on experience as a Data Analyst working with product or platform data
  • Strong proficiency in Python for analytical work and ability to independently investigate data on the level of datapoints, build structural analyses, and present results
  • Confident SQL skills with experience working on complex queries
  • Experience building production-grade dashboards in BI tools, preferably in Tableau
  • Clear understanding of how LLM-based systems operate, including their limitations, failure modes, and trade-offs
  • Strong problem-solving and ownership mindset: you take responsibility for analytical outcomes, not just task execution
  • Ability to work in fast-changing, ambiguous environments and quickly learn new AI-related technologies
  • Proven experience linking product quality metrics to business impact and decision-making
  • Fluent Russian; English level B2 or higher
  • Ability to work CET-overlapping hours, with location outside Belarus and Russia

Nice to Have

  • Experience evaluating or analyzing AI / ML / LLM products
  • Experience with dialog systems or conversational agents
  • Understanding of model quality metrics and evaluation approaches

Responsibilities:

  • Analyze the performance and impact of AI initiatives already running in production
  • Develop and maintain dashboards that provide transparency into AI agent performance
  • Investigate issues, inconsistencies, and performance drops across automated user journeys
  • Design and implement evaluation approaches to measure system quality and user experience
  • Identify opportunities where automation improves outcomes, as well as areas where it introduces friction
  • Track adoption and effectiveness of automation across the product and support its further evolution
  • Partner closely with Product, Engineering, and QA teams to support data-informed decisions

Why Join Us

  • Work on a modern AI product where quality is a strategic function, not a formality
  • Real influence on product direction and engineering practices
  • High-impact work in a product-driven medical tech company
  • Startup environment: fast iteration, high ownership, minimal bureaucracy
  • Competitive compensation and growth opportunities

Benefits

  • Health insurance after probation period
  • Sports & wellness compensation
  • Fully remote, long-term B2B collaboration
  • 19 working days of vacation per year
  • 4 additional wellness days per year
  • Paid sick leave for the first 5 working days
  • Gifts to employees for important events
  • Career Development
  • Personalized English lessons via Preply

Ready to make an impact? Send us your profile - let’s build something meaningful together.

Similar Jobs

Explore other opportunities that match your interests

Data Analyst

Data Science
•
2d ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

medvidi

Poland
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Entry level

gauss & neumann

Poland

Data Analyst - Big Data Insights

Data Science
•
1w ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Bending Spoons

Poland

Subscribe our newsletter

New Things Will Always Update Regularly