Senior Data Engineer (Databricks) - GenAI Solutions Development

Senior Data Engineer (Databricks)

Contract | Fully remote | Start Feb | 6+ months

SR2 is supporting an AI consultancy that requires an experienced Data Engineer and GenAI consultant, who has hands-on Databricks engineer. You will step into an existing delivery and take ownership of GenAI solution development. This is a highly practical role, combining deep technical delivery with light team leadership and stakeholder-facing responsibility.

The Role

You’ll join an established AI programme as a senior GenAI specialist, responsible for designing, building and delivering scalable GenAI solutions on Databricks. This is a hands-on delivery role first and foremost, with the opportunity to guide a small team and shape how GenAI capabilities are implemented in a production environment.

Key Responsibilities:

• Deliver end to end GenAI solutions on Databricks, from experimentation through to production
• Apply Databricks GenAI capabilities including Vector Search, Model Serving, AI Gateway and MLflow
• Build and maintain Python-based GenAI pipelines using modern LLM frameworks (eg. LangChain)
• Contribute to and review code via GitHub, managing branches, PRs and merge conflicts
• Support Databricks development and testing practices (Asset Bundles, CLI, Connect, pytest)
• Provide day-to-day technical leadership for a small team (task breakdown, estimation, unblocking)
• Report delivery progress and risks to the Head of AI

Requirements:

• Strong hands-on experience delivering GenAI solutions in production
• Deep experience with Databricks, particularly GenAI and AI platform features
• Advanced Python development skills and experience with LLM libraries
• Solid understanding of common GenAI use cases (RAG, agents, evaluation, orchestration)
• Experience working in collaborative GitHub-driven delivery environments
• Comfortable operating autonomously within a client-facing consultancy setting

Overview:

• Start date: February 2026
• Initial end date: July 2026
• Extensions: likely to extend for another 6 months
• Location: Fully remote (you can work remotely in UK or EU, as long as you have the right to work in the UK)
• IR35 status: TBC
• Rate: Negotiable and DOE

Please apply with a copy of your CV and Emma from SR2 will contact potential candidates regarding next steps.