Tech Lead / Lead Data Engineer - Outside IR35 - SC + NPPV3 Cleared

Newington, Greater London
5 days ago
Create job alert

Tech Lead / Lead Data Engineer (AWS Data Platform)
Rate: £500 - £550 p/d outside IR35
Length: 1st April to end of November (initially)
Location: London (hybrid – typically 1 day per week on-site, remaining remote)
Security Clearance: SC Clearance essential + NPPV3

Overview
We’re looking for a hands-on Tech Lead to lead a small team delivering secure, scalable data solutions within a highly regulated environment. You’ll take technical ownership across an AWS-based data platform using S3, Glue, and Redshift, working closely with delivery leadership, architecture stakeholders, and product teams to deliver incremental value.

This role suits someone who can balance technical leadership, hands-on engineering, and stakeholder-facing communication, while maintaining strong standards around security, quality, and operational resilience.

Key Responsibilities
Lead and mentor a small engineering team across data engineering, analytics engineering, and DevOps.
Own the technical design of data ingestion, transformation, storage, and access patterns.
Drive engineering standards including code quality, testing, CI/CD, Infrastructure as Code, and security-by-design.
Translate high-level requirements into solution increments, technical designs, and well-scoped delivery tickets.
Deliver and optimise data modelling approaches (e.g., star/snowflake schemas) and performance tuning practices.
Build reliable and cost-effective ETL/ELT pipelines, including orchestration and event-driven patterns where appropriate.
Partner with security stakeholders to ensure compliance, including IAM least privilege, encryption, auditability, and secure access controls.
Implement and maintain CI/CD pipelines for data workflows and platform components.
Ensure strong monitoring and operational discipline using cloud-native tooling and engineering best practice.
Communicate technical decisions, trade-offs, risks, and delivery progress to senior stakeholders.
Promote a culture of learning, quality, and continuous improvement.Required Skills & Experience
Proven experience as a Tech Lead / Lead Data Engineer delivering AWS-based data platforms.
Strong hands-on AWS experience, including:

Amazon S3 (data lake patterns, partitioning, lifecycle policies, cost optimisation)
AWS Glue (Jobs, Crawlers, PySpark, Glue Data Catalog, orchestration)
Amazon Redshift (performance tuning, sort/dist keys, Spectrum, WLM)
Strong development skills across:

Python (including PySpark)
SQL (DDL/DML, analytical queries, data performance considerations)
Experience with Infrastructure as Code (Terraform or CloudFormation).
CI/CD experience using tools such as GitHub Actions, Azure DevOps, CodePipeline, CodeBuild, etc.
Strong understanding of security & governance in regulated environments:

IAM, KMS encryption, Secrets Manager/SSM, audit logging
Delivery capability across Agile (Scrum/Kanban) environments with strong backlog refinement discipline.
Confident stakeholder management with the ability to explain technical choices and gain consensus

Related Jobs

View all jobs

Lead Data & Platform Engineer

Data Engineering Lead

Head of Data

Lead Engineer/Head of Software Engineering

Software Engineer Lead

Lead Automation Test Architect

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How to Write a Cloud Computing Job Ad That Attracts the Right People

Cloud computing underpins much of the UK’s digital economy. From startups and scale-ups to enterprise organisations and the public sector, cloud platforms enable everything from data analytics and AI to cybersecurity, DevOps and digital services. Yet despite high demand for cloud skills, many employers struggle to attract the right candidates. Cloud job adverts are often flooded with unsuitable applications, while experienced cloud engineers, architects and platform specialists quietly pass them by. In most cases, the problem is not the shortage of cloud talent — it is the quality and clarity of the job advert. Cloud professionals are pragmatic, technically experienced and highly selective. A poorly written job ad signals confusion, unrealistic expectations or a lack of cloud maturity. A well-written one signals credibility, good engineering culture and long-term thinking. This guide explains how to write a cloud computing job ad that attracts the right people, improves applicant quality and strengthens your employer brand.

Maths for Cloud Jobs: The Only Topics You Actually Need (& How to Learn Them)

If you are applying for cloud computing jobs in the UK you might have noticed something frustrating: job descriptions rarely ask for “maths” directly yet interviews often drift into capacity, performance, reliability, cost or security trade-offs that are maths in practice. The good news is you do not need degree-level theory to be job-ready. For most roles like Cloud Engineer, DevOps Engineer, Platform Engineer, SRE, Cloud Architect, FinOps Analyst or Cloud Security Engineer you keep coming back to a small set of practical skills: Units, rates & back-of-the-envelope estimation (requests per second, throughput, latency, storage growth) Statistics for reliability & observability (percentiles, error rates, SLOs, error budgets) Capacity planning & queueing intuition (utilisation, saturation, Little’s Law) Cost modelling & optimisation (right-sizing, break-even thinking, cost per transaction) Trade-off reasoning under constraints (performance vs cost vs reliability) This guide explains exactly what to learn plus a 6-week plan & portfolio projects you can publish to prove it.

Neurodiversity in Cloud Computing Careers: Turning Different Thinking into a Superpower

Cloud computing sits at the heart of modern tech. Almost every digital product runs on someone’s cloud platform – from banking apps & streaming services to AI tools & online shops. Behind those platforms are teams of cloud engineers, architects, SREs, security specialists & more. These roles demand problem-solvers who can think in systems, spot patterns, stay calm under pressure & imagine better ways to build & run infrastructure. That makes cloud computing a natural fit for many neurodivergent people – including those with ADHD, autism & dyslexia. If you are neurodivergent & considering a cloud career, you might have heard messages like “you’re too distracted for engineering”, “too literal for stakeholder work” or “too disorganised for operations”. In reality, many traits that come with ADHD, autism & dyslexia are exactly what cloud teams need. This guide is written for cloud computing job seekers in the UK. We will cover: What neurodiversity means in a cloud context How ADHD, autism & dyslexia strengths map to cloud roles Practical workplace adjustments you can ask for under UK law How to talk about neurodivergence in applications & interviews By the end, you should have a clearer sense of where you might thrive in cloud computing – & how to turn “different thinking” into a professional superpower.