Future Tech Jobs Future Tech Jobs

Lead Data Engineer

Canada Life
London, United Kingdom
2 weeks ago
Applications closed

Related Jobs

View all jobs

Lead Data Engineer

Edison Hill Search Lime Street, City And County Of the City Of London, United Kingdom
£90,000 – £100,000 pa Hybrid

Lead Data Platform Engineer | |+ 4 day week

Akkodis United Kingdom
£70,000 – £85,000 pa Remote

Data Engineer, Strategic Account Services

Amazon London, United Kingdom
Permanent

AWS Data Engineer

Bis Henderson Leicestershire, United Kingdom
£70,000 – £80,000 pa Hybrid

Data Migration Engineer

Head Resourcing Leeds, United Kingdom

Senior AWS Data engineer (LDW Data Warehouse Discovery)

Experis Telford, Shropshire, SY2 5TN, United Kingdom
£400 – £480 pd Hybrid Clearance Required
Job Type
Permanent
Work Pattern
Full-time
Work Location
Hybrid
Seniority
Lead
Education
Degree
Posted
30 Apr 2026 (2 weeks ago)
Share
Save job
Create job alert

Location: London, Watford or Bristol (Hybrid working options available)

The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires strong expertise in Azure cloud services, Databricks, data engineering, and DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions.

The role involves:

  • Interpreting Outcomes and user stories and translating them into technical solutions.
  • Creating innovative solution designs for domain and enterprise data products.
  • Overseeing Data Analysts to support detailed data discovery.
  • Overseeing data modelling for Finance and Enterprise data products.
  • Leading Product Increment planning to break down solutions into Features and Epics for incremental delivery.
  • Designing and implementing scalable data solutions on Azure and Databricks within the assigned domain.
  • Ensuring appropriate engineering standards are applied to maintain data quality, performance and reliability.

Duties/Responsibilities

  • Work with Product Owners and Business Analysts to understand Outcomes, refine user stories.
  • Lead solution design for Finance and Enterprise data products, ensuring alignment with enterprise patterns and guardrails.
  • Direct and collaborate with Data Analysts on detailed data discovery, source understanding and requirements refinement.
  • Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required.
  • Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake).
  • Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established patterns.
  • Apply security, access control and compliance standards for Azure and Databricks in collaboration with platform and security teams.
  • Support monitoring, logging and basic cost optimisation for the team’s data products.
  • Support the development of DevOps practices within the team, including reducing technical debt and improving automation over time.

Skills, Knowledge and Experience

Lead Data Engineers are expected to have strong capability in at least three of the following areas of engineering practice.

Core skills

  • Automation including testing of data pipelines and data products.
  • Strong teamwork, communication and problem-solving skills to collaborate effectively with cross-functional teams.
  • Awareness of security principles and best practices to ensure secure data solutions.
  • Commitment to continuous learning and staying current with Azure, Databricks and data engineering trends.
  • Strong experience working within an agile development methodology, ideally Scaled Agile (SAFe or similar).
  • Excellent time and self-management through effective planning and prioritisation of tasks.
  • Proven and demonstrable data engineering capability.
  • Ability to influence within the team and communicate clearly with technical and non-technical stakeholders.

Data Engineer (New Technology / Microsoft)

  • Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous).
  • Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous).
  • Experience contributing to CI/CD pipelines (Azure DevOps, GitHub Actions, Terraform).
  • Scripting and programming skills (Python advantageous).
  • Good understanding of DevOps and automation concepts (e.g. YAML pipelines, IaC).
  • Solid understanding of cloud security, compliance and governance principles.
  • Experience working with Databricks and Azure in a product or Scaled Agile delivery environment.

Qualifications

  • Degree level IT or technical/scientific subject (or equivalent experience).
  • Microsoft Azure Data Engineer or Solutions Architect certification (desirable).
  • Databricks Certified Data Engineer or Machine Learning Associate (desirable).
  • Experience with streaming solutions (Kafka, Event Hubs, Spark Streaming) (desirable).
  • Knowledge of machine learning and AI on Databricks (desirable).

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Products

Where to Advertise Cloud Computing Jobs in the UK (2026 Guide)

Where to advertise cloud computing jobs UK in 2026: the specialist boards and channels that reach AWS, Azure, GCP and cloud-native engineering talent. The candidate pool is large relative to other deep tech disciplines but highly segmented — cloud architects, DevOps engineers, platform engineers, FinOps specialists and cloud security professionals each occupy distinct communities with different job search behaviours, certification profiles and salary expectations. General job boards reach a broad audience but struggle to differentiate between these disciplines, producing high application volumes but low candidate quality for specialist cloud roles. This guide, published by CloudComputingJobs.co.uk, covers where to advertise cloud computing roles in the UK in 2026, how the main platforms compare, what employers should expect to pay, and what the data says about hiring across different role types.

Jobs

Cloud Computing Jobs UK 2026: What to Expect Over the Next 3 Years

Cloud Computing Jobs UK 2026: salaries, hiring trends and the AWS, Azure and GCP skills shaping UK cloud careers over the next three years. Cloud computing is the infrastructure layer on which the modern digital economy runs — and the jobs market that has grown around it is one of the largest, most sustained, and most structurally resilient in the entire technology sector. But the cloud computing jobs market of 2026 looks quite different from the one that existed three years ago, and the next three years will bring further change at a pace that rewards those who understand the direction of travel. The migration phase that defined cloud hiring for much of the previous decade is largely complete for enterprise organisations. The question for most UK businesses is no longer whether to move to the cloud but how to operate, optimise, and secure what they have already built there — and how to integrate the wave of AI capability that is now being delivered primarily through cloud infrastructure. That shift has profound implications for which cloud skills are in demand, which roles are growing, and which are beginning to plateau. At the same time, new architectural patterns — multi-cloud, cloud-native, serverless, and the growing integration of edge computing with centralised cloud infrastructure — are creating entirely new categories of specialist expertise that employers are actively competing to hire. The cloud computing jobs market of 2026 is not contracting. It is evolving, and evolving in ways that create significant opportunity for job seekers who are building the right skills. This article breaks down what the UK cloud computing jobs market is likely to look like through to 2028 — covering the titles emerging right now, the technologies driving employer demand, the skills that will matter most, and how to position your career ahead of the curve.

Jobs

New Cloud Computing Employers to Watch in 2026: UK and Global Companies Powering the Digital Economy

New Cloud Computing Employers to Watch in 2026: a UK and global shortlist of cloud providers and SaaS firms hiring AWS, Azure, GCP and cloud-native talent. Cloud computing is no longer just a backbone technology—it is now the engine of digital transformation, underpinning everything from AI and fintech to healthcare and government services. For professionals browsing CloudComputingJobs.co.uk, the biggest opportunities lie with new and fast-scaling employers that are investing heavily in infrastructure, platforms, and next-generation cloud services. In this article, we explore the new cloud computing employers to watch in 2026, focusing on UK-based startups, scale-ups, and global companies expanding their footprint across Britain. These organisations have recently secured funding, launched major projects, or won strategic contracts—clear signals of hiring growth.

🍪 Basic, anonymous analytics (aggregate counts only, never shared) are always on. Accept to also enable third-party tools — Google Analytics, Microsoft Clarity, Mixpanel, Leadfeeder — which help us match you with relevant Cloud Computing roles. We never sell your data or use it for cross-site advertising. See our Cookie Policy.