Senior Data Platform Engineer

About Mendel: At Mendel, we are enabling different stakeholders in healthcare to make better decisions by learning from every patient's journey— from a physician deciding on the best treatment for a patient to a pharma company discovering the next blockbuster drug. In creating depth and breadth for a patient’s health record journey, Mendel enables the right care to be delivered at the right time to the right person. This is an incredible opportunity to join a unique vision to improve healthcare using AI technology.

About the Role:

We seek a highly skilled and experienced Data Platform Engineer to join our dynamic team. The ideal candidate will have a strong background in designing, building and maintaining AI/ML platforms for scale and resiliency. In this role, you will play a critical part in shaping our data infrastructure and ensuring that data is available, reliable, and ready for analysis. Your expertise in data engineering will contribute to our organization's data-driven decision-making and overall success.

Responsibilities:

• Design, develop, and maintain an AI/ML platform to enable the AI to build LLM, Bert, and other models.
• Build robust ML training and inference pipelines using MLFlow, Kubeflow, Ray, and Spark.
• Ensure the performance, quality, and responsiveness of the models.
• Collaborate with cross-functional teams to define, design, and ship new features.
• Continuously discover, evaluate, and implement new technologies to maximize development efficiency.

Qualifications:

• Bachelor’s degree in Computer Science, Statistics, Mathematics, or a related field. Advanced degrees are preferred.
• Minimum of 5 years of experience in building and maintaining AI/ML platforms using Kubernetes, MLFlow, Kubeflow, Ray, and Spark.
• Strong knowledge of machine learning frameworks, libraries, data structures, data modeling, and software architecture.
• Good understanding of machine learning algorithms, processes, tools, and platforms.
• Experience with cloud services (GCP, AWS, Azure). Cloud-agnostic deployment experience is highly encouraged.
• Excellent problem-solving skills and ability to work in a team environment.

Preferred Skills:

• Experience with startup environments and agile development methodologies.
• Strong communication skills with the ability to explain technical concepts to non-technical audiences.
• Knowledge of data streaming technologies (e.g., Apache Kafka).
• Experience with data visualization tools (e.g., Tableau, Power BI).
• Certification in relevant data engineering technologies.

P.S.: This role will require you working out of our San Jose office. Please feel free to apply if you are local or open to relocation.

Why should you join our team:

Benjamin Franklin once said: “If you would not be forgotten as soon as you are dead, either write something worth reading, or do something worth writing.” — at Mendel you can do the latter. There are two things more devastating than learning that you or your loved ones have a terminal illness; getting the wrong treatment or not finding any. At Mendel, we are on a sincere mission to solve many never-solved-before technology challenges that can enable prescribers and drug makers to do their best