Data Engineer – SC Cleared - AWS - Inside IR35

Farringdon, Greater London
5 days ago
Create job alert

Data Engineer – SC Cleared - AWS - Inside IR35
We are supporting a major government data transformation initiative to strengthen the use of evidence-based insights across frontline and operational teams. As part of a new capability being built to process and analyse sensitive interview information, the programme requires Data Engineers to design, deliver, and optimise secure backend data workflows.
This work is foundational: building the ingestion, orchestration, storage, and transformation layers that power the analytics tool.
Key Responsibilities

Design, develop and maintain scalable cloud-native data pipelines
• Implement ETL/ELT processes to manage structured and unstructured data securely and efficiently
• Ensure data integrity, traceability and compliance across all pipeline stages
• Work with cross-functional teams to define technical requirements and design decisions
• Apply DevOps best practices, monitoring, and automation to improve reliability
• Support continuous improvement of the platform’s performance and operational maturity
• Communicate progress, risks and trade-offs clearly to wider delivery stakeholdersRequired Skills & Experience

Strong Data Engineering expertise within AWS environments
• Hands-on experience with core AWS data services:
 – S3, Glue, Lambda, Athena, Kinesis, Step Functions (or similar)
• Proficiency in Python and SQL for data transformations and automation
• Experience with IaC and CI/CD tooling (Terraform, GitLab, etc.)
• Comfortable working with sensitive datasets and secure-by-design approaches
• Strong communication skills and a proactive, consulting mindset
• Experience delivering as part of an Agile, multi-disciplinary teamDesirable

Knowledge of backend processing for analytics workloads (but not essential)
• Familiarity with containerised deployments (Docker/ECS)
• Experience working to SFIA-aligned delivery expectations in government or regulated contexts

Related Jobs

View all jobs

Data Engineer – SC Cleared – Databricks

Junior / Mid Level Data Engineer - Inside IR35 - SC Cleared

Data Engineer – AWS – SC Cleared

AWS Data Platform Engineer (SC Cleared)

Software Engineer - SC Cleared

Software Engineer - SC Cleared

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How to Write a Cloud Computing Job Ad That Attracts the Right People

Cloud computing underpins much of the UK’s digital economy. From startups and scale-ups to enterprise organisations and the public sector, cloud platforms enable everything from data analytics and AI to cybersecurity, DevOps and digital services. Yet despite high demand for cloud skills, many employers struggle to attract the right candidates. Cloud job adverts are often flooded with unsuitable applications, while experienced cloud engineers, architects and platform specialists quietly pass them by. In most cases, the problem is not the shortage of cloud talent — it is the quality and clarity of the job advert. Cloud professionals are pragmatic, technically experienced and highly selective. A poorly written job ad signals confusion, unrealistic expectations or a lack of cloud maturity. A well-written one signals credibility, good engineering culture and long-term thinking. This guide explains how to write a cloud computing job ad that attracts the right people, improves applicant quality and strengthens your employer brand.

Maths for Cloud Jobs: The Only Topics You Actually Need (& How to Learn Them)

If you are applying for cloud computing jobs in the UK you might have noticed something frustrating: job descriptions rarely ask for “maths” directly yet interviews often drift into capacity, performance, reliability, cost or security trade-offs that are maths in practice. The good news is you do not need degree-level theory to be job-ready. For most roles like Cloud Engineer, DevOps Engineer, Platform Engineer, SRE, Cloud Architect, FinOps Analyst or Cloud Security Engineer you keep coming back to a small set of practical skills: Units, rates & back-of-the-envelope estimation (requests per second, throughput, latency, storage growth) Statistics for reliability & observability (percentiles, error rates, SLOs, error budgets) Capacity planning & queueing intuition (utilisation, saturation, Little’s Law) Cost modelling & optimisation (right-sizing, break-even thinking, cost per transaction) Trade-off reasoning under constraints (performance vs cost vs reliability) This guide explains exactly what to learn plus a 6-week plan & portfolio projects you can publish to prove it.

Neurodiversity in Cloud Computing Careers: Turning Different Thinking into a Superpower

Cloud computing sits at the heart of modern tech. Almost every digital product runs on someone’s cloud platform – from banking apps & streaming services to AI tools & online shops. Behind those platforms are teams of cloud engineers, architects, SREs, security specialists & more. These roles demand problem-solvers who can think in systems, spot patterns, stay calm under pressure & imagine better ways to build & run infrastructure. That makes cloud computing a natural fit for many neurodivergent people – including those with ADHD, autism & dyslexia. If you are neurodivergent & considering a cloud career, you might have heard messages like “you’re too distracted for engineering”, “too literal for stakeholder work” or “too disorganised for operations”. In reality, many traits that come with ADHD, autism & dyslexia are exactly what cloud teams need. This guide is written for cloud computing job seekers in the UK. We will cover: What neurodiversity means in a cloud context How ADHD, autism & dyslexia strengths map to cloud roles Practical workplace adjustments you can ask for under UK law How to talk about neurodivergence in applications & interviews By the end, you should have a clearer sense of where you might thrive in cloud computing – & how to turn “different thinking” into a professional superpower.