Senior MLOps Engineer (Databricks Ecosystem)

kdata ai • Canada
Remote
Apply
AI Summary

Seeking a skilled MLOps Engineer with Databricks expertise for a 6-month remote initiative. Responsibilities include automating ML pipelines, managing model lifecycles, and optimizing infrastructure. Requires 6+ years of experience, with 3+ in MLOps, and proficiency in Python, SQL, and Databricks tools.

Key Highlights
6-month critical initiative
Focus on Databricks ecosystem for MLOps
Bridge gap between Data Science and Data Engineering
Key Responsibilities
Design, build, and maintain robust CI/CD and MLOps pipelines for machine learning model training, evaluation, deployment, and batch/real-time scoring using Databricks Jobs and Workflows.
Implement and manage experiment tracking, model registration, versioning, and environment promotion policies using MLflow and Unity Catalog.
Optimize Databricks clusters and computational workloads for ML training and inference to ensure both cost-efficiency and high performance.
Collaborate with data engineers to build and maintain scalable feature pipelines utilizing Databricks Feature Store / Delta Lake.
Establish proactive monitoring frameworks to track model performance, data drift, concept drift, and system health in production environments.
Partner closely with Data Scientists to transition proof-of-concept (PoC) code into scalable, production-ready ML products.
Technical Skills Required
Python SQL PySpark Databricks MLflow Unity Catalog Delta Lake Databricks Repos GitHub Actions GitLab CI Jenkins Azure DevOps AWS Azure GCP
Benefits & Perks
100% Remote
Nice to Have
Active Databricks certifications (e.g., Databricks Certified Machine Learning Professional).
Experience with Infrastructure as Code (IaC) tools like Terraform.
Familiarity with containerization (Docker, Kubernetes).
Exposure to LLMOps or serving GenAI models on Databricks.

Job Description


This is a remote position.

Position Overview
We are seeking a highly skilled MLOps Engineer with deep expertise in the Databricks ecosystem to join our data team for a critical 6-month initiative. In this role, you will bridge the gap between Data Science and Data Engineering, focusing on automating, scaling, and managing the end-to-end lifecycle of our machine learning models.
The ideal candidate will have a strong foundation in software engineering and production-grade DevOps practices, specifically optimized for machine learning pipelines (MLOps) within cloud-native Databricks environments.
Key Responsibilities

  • Pipeline Automation: Design, build, and maintain robust CI/CD and MLOps pipelines for machine learning model training, evaluation, deployment, and batch/real-time scoring using Databricks Jobs and Workflows.
  • Model Lifecycle Management: Implement and manage experiment tracking, model registration, versioning, and environment promotion policies using MLflow and Unity Catalog.
  • Infrastructure & Optimization: Optimize Databricks clusters and computational workloads for ML training and inference to ensure both cost-efficiency and high performance.
  • Data & Feature Engineering: Collaborate with data engineers to build and maintain scalable feature pipelines utilizing Databricks Feature Store / Delta Lake.
  • Monitoring & Observability: Establish proactive monitoring frameworks to track model performance, data drift, concept drift, and system health in production environments.
  • Collaboration: Partner closely with Data Scientists to transition proof-of-concept (PoC) code into scalable, production-ready ML products.



Requirements

Required Qualifications
  • Experience: 6+ years of professional experience in Software Engineering, Data Engineering, or DevOps, with at least 3+ years dedicated to MLOps.
  • Databricks Mastery: Hands-on experience architecting ML workflows within Databricks (including MLflow, Unity Catalog, Delta Lake, and Databricks Repos).
  • Core Languages: Advanced proficiency in Python and SQL. Strong skills in PySpark are highly desired.
  • CI/CD & DevOps: Proven experience building automated deployment pipelines using tools such as GitHub Actions, GitLab CI, Jenkins, or Azure DevOps.
  • Cloud Infrastructure: Familiarity with major cloud environments (AWS, Azure, or GCP) and cloud data infrastructure.
  • Education: Bachelor’s degree in Computer Science, Data Science, Engineering, or equivalent practical experience.
Preferred (Nice-to-Have) Skills
  • Active Databricks certifications (e.g., Databricks Certified Machine Learning Professional).
  • Experience with Infrastructure as Code (IaC) tools like Terraform.
  • Familiarity with containerization (Docker, Kubernetes).
  • Exposure to LLMOps or serving GenAI models on Databricks.
Why Work With Us?
  • 100% Remote: Enjoy the flexibility of a fully remote setup.
  • Impactful Work: Own a dedicated stream of work on high-priority ML initiatives over the next 6 months.
  • Cutting-Edge Stack: Work on modern, clean Databricks infrastructure.

Similar Jobs

Explore other opportunities that match your interests

MLOps Engineer (Databricks)

Devops
•
10h ago
Visa Sponsorship Relocation Remote
Job Type Contract
Experience Level Entry level

kdata ai

Canada

Observability Engineer II

Devops
•
1d ago
Visa Sponsorship Relocation Remote
Job Type Contract
Experience Level Mid-Senior level

vertisystem (a mouri tech comp...

Canada

Senior Site Reliability Engineer - Global, Fully Remote

Devops
•
2d ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Jobgether

Canada

Subscribe our newsletter

New Things Will Always Update Regularly