Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Databricks Data Engineer

London
1 week ago
Create job alert

Data Engineer - Active SC, Databricks, PySpark

Up to £475 per day (Inside IR35)

Remote / London

6 months

My client is an International Consultancy who are recruiting for an Data Engineer with Active Security Clearance (SC) and strong Databricks and Azure experience to deliver and optimise Data engineering solutions.

Key requirements:

Proven experience as a Data Engineer with Active Security Clearance (SC)
Strong experience with Databricks, PySpark and Delta Lake
Expertise in Jobs & Workflows, cluster tuning, and performance optimisation
Solid understanding of Data governance (Unity Catalog, Lineage, Access Policies)
Hands-on with Azure services: Data Lake Storage (Gen2), Key Vault, Azure Functions
Familiarity with CI/CD for Databricks deployments
Strong troubleshooting in distributed Data environments
Excellent communication and collaboration skills
Nice to have:

Immediate availability
Experience with enterprise-scale Databricks environments
Knowledge of Azure Synapse, Power BI and cost optimisation strategies

If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.
If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career.

Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at (url removed)

Related Jobs

View all jobs

Senior Data Engineer/ Scientist

Azure Databricks Engineer - Contract

Head of Data Engineering

Head of Data Engineering

Data Architect (Insurance Domain)

Data Engineer - London - Databricks - Azure - 70k + bonus

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Cloud Computing Hiring Trends 2026: What to Watch Out For (For Job Seekers & Recruiters)

As we move into 2026, the cloud computing jobs market in the UK is shifting again. The era of “lift & shift everything to the cloud” is giving way to a more mature, cost-conscious & security-focused phase. Many organisations are tightening budgets, some are rationalising cloud spend, yet demand for strong cloud talent remains high – especially around multi-cloud, FinOps, cloud security, data platforms & AI on cloud. Vendors are racing to integrate generative AI into their offerings, enterprises are modernising legacy estates, & regulators are asking tougher questions about resilience, sovereignty & risk. At the same time, some roles are being automated or commoditised, & the bar for cloud roles keeps rising. Whether you are a cloud job seeker planning your next move, or a recruiter building cloud teams, understanding the key cloud computing hiring trends for 2026 will help you stay ahead.

Cloud Computing Recruitment Trends 2025 (UK): What Job Seekers Must Know About Today’s Hiring Process

Summary: UK cloud hiring has shifted from title-led CV screens to capability-driven assessments that emphasise platform reliability, cost control (FinOps), defence-in-depth security, automation via IaC, high-availability design, and measurable business impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for platform engineers, SREs, cloud security engineers, DevOps, solutions architects, FinOps practitioners & data/AI platform engineers. Who this is for: Cloud/platform engineers, SREs, DevOps, cloud security, FinOps, network engineers, solutions/enterprise architects, data/ML platform engineers, observability engineers & cloud product managers targeting roles in the UK.

Why Cloud Computing Careers in the UK Are Becoming More Multidisciplinary

For many years, cloud computing careers in the UK meant roles for infrastructure specialists, system administrators, network engineers & software developers. Today, the picture looks very different. Cloud has become the backbone of digital transformation across industries — from healthcare to finance, education to government. With that reach comes new expectations. Cloud isn’t just about servers & storage anymore. It’s about handling sensitive data responsibly, meeting regulatory obligations, designing intuitive user experiences, communicating clearly with diverse stakeholders & understanding how people actually interact with complex digital systems. This means cloud careers are increasingly multidisciplinary, requiring expertise in law, ethics, psychology, linguistics & design alongside technical skills. In this article, we’ll explore why cloud careers in the UK are broadening, how these five disciplines intersect with cloud work, what it means for job-seekers & employers, and how to future-proof your career in this fast-changing sector.