Lead AI Engineer (LLM & Platform) - Remote Canada

Harvey Nash • Canada
Remote
Apply
AI Summary

Harvey Nash is seeking a Lead AI Engineer to design, build, and scale production-grade AI features, focusing on LLM-powered systems. This hands-on role requires deep AI/ML expertise, strong software engineering fundamentals, and experience with cloud-native architectures. The engineer will architect RAG pipelines, agentic workflows, and scalable Python microservices, while mentoring teams and influencing best practices.

Key Highlights
Design, build, and scale AI-powered features in production environments.
Focus on LLM-powered systems, RAG pipelines, and agentic workflows.
Develop scalable Python microservices and contribute to cloud-native architectures.
Technical Skills Required
Python FastAPI Flask Django Databricks pgVector Docker Kubernetes AWS GCP Azure LangChain Google ADK
Benefits & Perks
100% remote anywhere in Canada
Full-time employment

Job Description


Job Title: Lead AI Engineer (LLM & Platform)

Location: 100% remote anywhere in Canada

Duration: Full-time


Job Description:

Role Overview

We are seeking a highly experienced Lead AI Engineer to design, build, and scale AI-powered features used in production environments. This role is hands-on and execution-focused, combining deep AI/ML expertise with strong software engineering fundamentals. You will play a key role in shaping our AI architecture, validating AI capabilities through experimentation, and delivering reliable, high-quality AI systems at scale.

Key Responsibilities

  • Design, develop, and deploy production-grade AI/ML features, with a strong focus on LLM-powered systems.
  • Architect and implement RAG pipelines, agentic workflows, and AI services using vector databases such as Databricks, pgVector, or equivalent.
  • Build scalable Python-based microservices using frameworks like FastAPI, Flask, or Django.
  • Collaborate with product, data, and engineering teams to translate business problems into effective AI solutions.
  • Define and execute experimentation strategies, including A/B testing, evaluation frameworks, and hypothesis-driven validation of AI features.
  • Ensure high code quality and system reliability through testing, monitoring, observability, and performance optimization.
  • Contribute to cloud-native architectures leveraging AWS, GCP, or Azure, with containerization (Docker/Kubernetes) and CI/CD pipelines.
  • Mentor engineers and influence best practices in AI engineering, architecture, and delivery.

Core Technical Skills

  • 10+ years of software engineering experience, with significant hands-on focus on AI/ML systems in production.
  • Deep expertise in LLMs, including prompt engineering, RAG architectures, and agentic AI frameworks (e.g., LangChain, Google ADK, or similar).
  • Strong proficiency in Python and modern backend frameworks.
  • Solid foundation in statistical methods, data processing, ETL pipelines, and large-scale data workflows.
  • Experience with cloud platforms, container orchestration, and modern DevOps practices.
  • Strong understanding of AI system observability, monitoring, testing, and operational excellence.

Ways You’ll Stand Out (Nice to Have)

  • Experience with model fine-tuning, RLHF, or custom model training.
  • Familiarity with MLOps tools and metrics (e.g., MLflow, precision/recall, model evaluation frameworks).
  • Knowledge of frontend technologies (React) for full-stack contributions.
  • Background in NLP, multimodal AI, document processing, or real-time / streaming AI systems.
  • Open-source contributions, technical writing, or public speaking experience.


Similar Jobs

Explore other opportunities that match your interests

AI/ML Cloud Engineer

Devops
•
1d ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Cognizant

Canada

Platform Infrastructure Engineer

Devops
•
1d ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Menlo Security Inc.

Canada

Principal Cloud Practice Architect

Devops
•
3d ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Rackspace Technology

Canada

Subscribe our newsletter

New Things Will Always Update Regularly