Data Engineer - SC Cleared

Edinburgh
2 weeks ago
Create job alert

Role: Data Engineer

Location: Edinburgh or Luton (hybrid/onsite as required)
Engagement: Contract - Inside IR35
Security Clearance: Active SC Clearance required

Rate: £500 - £600 per day - inside IR35

Project Description

We are seeking an experienced Data Engineer to design, build, deploy, and maintain robust data platforms and pipelines within a secure environment. You will be responsible for the end-to-end data engineering lifecycle, transforming raw data into high-quality, consumable datasets that support analytics, reporting, and advanced modelling.

You will own and optimise the data operations infrastructure, ensuring performance, reliability, scalability, and security as data volumes and processing demands grow. This role requires strong problem-solving skills, the ability to integrate data from multiple sources, and hands-on experience with modern data engineering tools and practices.

Key Responsibilities

Design, develop, deploy, and support scalable data infrastructure, pipelines, and architectures

Orchestrate ingestion and storage of raw data into structured and unstructured data solutions

Implement reliable, automated, and well-tested data ingestion and processing workflows

Build and maintain batch and real-time data processing systems

Manage and optimise performance, reliability, scalability, and security of data platforms

Support data governance, quality, and compliance requirements

Prepare data pipelines for descriptive, predictive, and prescriptive analytics

Collaborate closely with data scientists, architects, IT teams, and business stakeholders

Identify opportunities for new data acquisition and improved data utilisation

Monitor, manage, and enhance data quality and reliability through automated tooling

Skills and Experience Required

Active SC Clearance (mandatory)

Strong experience designing and maintaining data pipelines, data warehouses, and data platforms

Solid knowledge of DataOps practices, including CI/CD, containerisation, and workflow orchestration

Hands-on experience with ETL/ELT frameworks and big data tools (e.g. Spark, Airflow, Hive)

Proficiency in programming languages such as Python, Java, and SQL

Experience with SQL and NoSQL database design and optimisation

Strong understanding of batch and streaming data processing

Degree in a STEM-related field; Master's degree desirable

Data engineering certifications (e.g. IBM Certified Data Engineer) are advantageous

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer (Automation)

Data Engineer (Snowflake and Matillion) - £425PD - Remote

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

What Hiring Managers Look for First in Cloud Computing Job Applications (UK Guide)

anding a job in cloud computing can be highly competitive — especially in the UK market where demand far outpaces supply in many segments. Whether you’re aiming for roles in Cloud Engineering, DevOps, Site Reliability, Cloud Architecture, Security, Data/Analytics, or Platform Operations, hiring managers screen applications quickly and with specific priorities in mind. Hiring managers don’t read every detail at first; they scan for critical signals in the first 10–20 seconds. These early signals determine whether your CV gets read more closely, whether your LinkedIn profile gets clicked, and whether you’re invited to interview. This guide breaks down, in practical terms, exactly what hiring managers look for first in cloud computing applications — and what you should emphasise in your CV, cover letter and portfolio to stand out on www.cloudcomputingjobs.co.uk .

The Skills Gap in Cloud Computing Jobs: What Universities Aren’t Teaching

Cloud computing underpins almost every modern digital service. From financial systems and healthcare platforms to AI, e-commerce, government infrastructure and cybersecurity, the cloud is now the default operating environment for UK organisations. Demand for cloud professionals has grown rapidly, with roles spanning architecture, engineering, security, DevOps, platform operations and cost optimisation. Salaries remain high, and vacancies remain stubbornly difficult to fill. Yet despite a growing number of graduates with computer science, IT and software engineering degrees, employers across the UK report a persistent problem: Too many candidates are not job-ready for real cloud computing roles. This is not a question of intelligence or motivation. It is a structural skills gap between what universities teach and what cloud jobs actually require. This article explores that gap in depth: what universities do well, what they consistently miss, why the gap exists, what employers genuinely want, and how jobseekers can bridge the divide to build sustainable careers in cloud computing.

Cloud Computing Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Thinking about switching into cloud computing in your 30s, 40s or 50s? You aren’t alone. Across the UK, employers are hiring professionals from diverse backgrounds to help organisations adopt, manage & optimise cloud technology. But let’s cut through the buzzwords. This guide gives you a practical, UK-focused reality check on cloud computing careers for career switchers — what roles exist, what you actually need to learn, how long it takes to retrain and, importantly, whether age matters. If you’re exploring a move into cloud computing, this article lays out what’s realistic and how to get there without falling for hype.