Senior Data Engineer (Azure)

Senior Data Engineer ( NPPV3 )

Location: Fully Remote (UK)

Security Clearance: NPPV3 required (or eligible)

Contract Type: Outside IR35

Rate: Competitive (DOE)

Start: ASAP / Flexible

Overview

We’re supporting a leading consultancy client delivering complex data platform and analytics programmes across regulated and public-sector environments. They’re looking to engage an experienced Senior Data Engineer to help design, build and scale modern cloud data platforms on Azure, with a strong focus on Databricks and modern lakehouse patterns.

This is a hands-on delivery role within multi-disciplinary teams, supporting clients moving from legacy or fragmented data estates towards scalable, cloud-native platforms.

Key Responsibilities

• Design and build robust, scalable data pipelines and platforms on Microsoft Azure
• Lead hands-on delivery using Databricks (PySpark / Spark SQL) for data engineering and transformation workloads

Interested in remote work opportunities in Data Science? Discover Data Science Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

• Develop and maintain ingestion frameworks (batch and streaming) from a variety of source systems
• Contribute to lakehouse architecture patterns using ADLS Gen2, Delta Lake, and modern data modelling approaches
• Work closely with solution architects, analytics engineers and stakeholders to translate requirements into technical solutions
• Champion data quality, reliability, performance and security best practices
• Support CI/CD, automation and infrastructure-as-code approaches within data engineering workflows
• Provide technical leadership and mentoring within delivery teams where appropriate

Required Skills & Experience

• Strong commercial experience as a Senior Data Engineer on Azure
• Proven hands-on delivery with Databricks (PySpark, Spark SQL, Delta Lake)
• Experience with core Azure services such as:
• Azure Data Lake Storage (ADLS Gen2)
• Azure Data Factory / Synapse Pipelines

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

• Azure DevOps (or similar CI/CD tooling)
• Strong SQL and data modelling experience
• Experience building production-grade data pipelines (batch and/or streaming)
• Comfortable working in agile delivery teams within consultancy or complex enterprise environments

Desirable

• Experience working in public sector or regulated environments
• Familiarity with lakehouse architectures and modern data platform patterns
• Exposure to data governance, security and platform best practice
• Experience operating in environments requiring NPPV3 or similar clearance

Clearance

• Active NPPV3 clearance is required (or candidates must be eligible and willing to go through the process).