Lead Data Engineer

London
1 week ago
Create job alert

Job Description:

The Lead Data Engineer will own the end-to-end technical delivery of the data migration and engineering programme. This role acts as the single technical point of accountability, setting architecture, defining standards, coordinating delivery across workstreams, and ensuring outputs meet the client’s quality, security, and scalability expectations.

Key Responsibilities

  • Own and evolve the AWS/CDP reference architecture for data ingestion, transformation, and consumption

  • Define and enforce engineering standards (Terraform, CI/CD, dbt, data modelling, naming conventions)

  • Oversee migration of ~8–10 enterprise databases into AWS using DMS/CDC and modern ingestion patterns

  • Ensure full data lineage, cataloguing, and documentation are produced

  • Coordinate backlog prioritisation, sprint planning, and delivery sequencing

  • Validate all technical deliverables for quality, performance, security, and operational readiness

  • Act as senior technical interface with stakeholders and delivery partners

  • Lead knowledge transfer and upskilling of engineers

    Required Experience & Skills

  • 5+ years in data engineering, including leadership or principal-level roles

  • Deep hands-on AWS experience: S3, Redshift, Glue, Lambda, EMR, DMS, IAM, Step Functions

  • Strong experience designing and delivering large-scale data migrations

  • Expert-level Python and SQL

  • Infrastructure-as-Code using Terraform

  • Data modelling and warehouse design (star schema, performance tuning)

  • Strong experience with dbt and modern ELT patterns

  • Excellent stakeholder communication and technical leadership skills

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer (Azure)

Lead Data & Platform Engineer

Lead Data Architect | Snowflake & AWS | £130k | Roadmap to Head of Engineering

Tech Lead / Lead Data Engineer - Outside IR35 - SC + NPPV3 Cleared

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

What Hiring Managers Look for First in Cloud Computing Job Applications (UK Guide)

anding a job in cloud computing can be highly competitive — especially in the UK market where demand far outpaces supply in many segments. Whether you’re aiming for roles in Cloud Engineering, DevOps, Site Reliability, Cloud Architecture, Security, Data/Analytics, or Platform Operations, hiring managers screen applications quickly and with specific priorities in mind. Hiring managers don’t read every detail at first; they scan for critical signals in the first 10–20 seconds. These early signals determine whether your CV gets read more closely, whether your LinkedIn profile gets clicked, and whether you’re invited to interview. This guide breaks down, in practical terms, exactly what hiring managers look for first in cloud computing applications — and what you should emphasise in your CV, cover letter and portfolio to stand out on www.cloudcomputingjobs.co.uk .

The Skills Gap in Cloud Computing Jobs: What Universities Aren’t Teaching

Cloud computing underpins almost every modern digital service. From financial systems and healthcare platforms to AI, e-commerce, government infrastructure and cybersecurity, the cloud is now the default operating environment for UK organisations. Demand for cloud professionals has grown rapidly, with roles spanning architecture, engineering, security, DevOps, platform operations and cost optimisation. Salaries remain high, and vacancies remain stubbornly difficult to fill. Yet despite a growing number of graduates with computer science, IT and software engineering degrees, employers across the UK report a persistent problem: Too many candidates are not job-ready for real cloud computing roles. This is not a question of intelligence or motivation. It is a structural skills gap between what universities teach and what cloud jobs actually require. This article explores that gap in depth: what universities do well, what they consistently miss, why the gap exists, what employers genuinely want, and how jobseekers can bridge the divide to build sustainable careers in cloud computing.

Cloud Computing Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Thinking about switching into cloud computing in your 30s, 40s or 50s? You aren’t alone. Across the UK, employers are hiring professionals from diverse backgrounds to help organisations adopt, manage & optimise cloud technology. But let’s cut through the buzzwords. This guide gives you a practical, UK-focused reality check on cloud computing careers for career switchers — what roles exist, what you actually need to learn, how long it takes to retrain and, importantly, whether age matters. If you’re exploring a move into cloud computing, this article lays out what’s realistic and how to get there without falling for hype.