Lead Platform Engineer

London

2 days ago

Create job alert

Lead Data Platform Engineer - Databricks - IAC - Terraform - Azure Data Factory - Data Lakehouse

The Data Platform Engineer designs, develops, automates, and maintains secure, scalable, and compliant data platforms that enable the firm to efficiently manage, analyse, and utilise data. The role ensures that data solutions are robust and reliable while meeting regulatory obligations and safeguarding client confidentiality.

Key Responsibilities

* Design and architect scalable, secure, and compliant data platforms and solutions, producing technical documentation and securing approvals through governance bodies such as Architecture Review Boards.

* Build and deliver robust data solutions using Databricks, PySpark, Spark SQL, Azure Data Factory, and Azure services.

* Develop APIs and write efficient Python, PySpark, and SQL code to support data integration, processing, and automation.

* Implement and manage CI/CD pipelines and automated deployments using Azure DevOps to enable reliable releases across environments.

* Develop and maintain infrastructure-as-code (eg, Terraform, ARM) to provision and manage cloud resources, including ADF pipelines, Databricks assets, and Unity Catalog components.

* Monitor, troubleshoot, and optimise data platform performance, reliability, and costs, identifying bottlenecks and recommending improvements.

Knowledge, Skills & Experience

* Degree in Computer Science, Data Engineering, or a related field.

* Proven experience designing and building cloud-based data platforms, ideally within Azure.

* Strong hands-on expertise with Databricks, PySpark, Spark SQL, and Azure Data Factory.

* Solid understanding of Data Lakehouse architecture and modern data platform design.

* Proficiency in Python for data engineering, automation, and data processing.

* Experience developing and integrating REST APIs for data services.

* Strong DevOps experience, including CI/CD, automated testing, and release management for data platforms.

* Experience with Infrastructure as Code tools such as Terraform or ARM templates.

* Knowledge of data modelling, ETL/ELT pipelines, and data warehousing concepts.

* Familiarity with monitoring, logging, and alerting tools (eg, Azure Monitor).

Desirable

* Experience with additional Azure services (eg, Fabric, Azure Functions, Logic Apps).

* Knowledge of cloud cost optimisation for data platforms.

* Understanding of data governance and regulatory compliance (eg, GDPR).

* Experience working in regulated or professional services environments

Related Jobs

View all jobs

Principal SRE - Site Reliability

Lead Azure Platform Engineer

Head of Cloud Platforms

Lead DevOps Engineer

OpenShift platform Engineer

Linux Engineer Lead

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Apr 9, 2026

Products

Where to Advertise Cloud Computing Jobs in the UK (2026 Guide)

Advertising cloud computing jobs in the UK requires a different approach to most technical hiring. The candidate pool is large relative to other deep tech disciplines but highly segmented — cloud architects, DevOps engineers, platform engineers, FinOps specialists and cloud security professionals each occupy distinct communities with different job search behaviours, certification profiles and salary expectations. General job boards reach a broad audience but struggle to differentiate between these disciplines, producing high application volumes but low candidate quality for specialist cloud roles. This guide, published by CloudComputingJobs.co.uk, covers where to advertise cloud computing roles in the UK in 2026, how the main platforms compare, what employers should expect to pay, and what the data says about hiring across different role types.

Mar 24, 2026

Jobs

New Cloud Computing Employers to Watch in 2026: UK and Global Companies Powering the Digital Economy

Cloud computing is no longer just a backbone technology—it is now the engine of digital transformation, underpinning everything from AI and fintech to healthcare and government services. For professionals browsing CloudComputingJobs.co.uk, the biggest opportunities lie with new and fast-scaling employers that are investing heavily in infrastructure, platforms, and next-generation cloud services. In this article, we explore the new cloud computing employers to watch in 2026, focusing on UK-based startups, scale-ups, and global companies expanding their footprint across Britain. These organisations have recently secured funding, launched major projects, or won strategic contracts—clear signals of hiring growth.

Feb 18, 2026

Jobs Careers

Cloud Engineer Jobs in the UK: Salary, Skills, Career Paths & How to Get Hired

Cloud engineer jobs are among the fastest-growing technology roles in the UK. As organisations move infrastructure, applications and data into the cloud, demand for skilled cloud professionals continues to surge across finance, healthcare, retail, defence, government and high-growth startups. If you’re exploring a career in cloud engineering — or looking for your next role — this guide covers everything you need to know: What a cloud engineer does Types of cloud engineer jobs Required skills and certifications UK salary expectations Career progression pathways How to land a cloud engineer job in the UK Whether you’re a graduate, IT professional transitioning into cloud, or an experienced engineer looking to specialise, this article will help you position yourself competitively.