Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Databricks Engineer

London
3 weeks ago
Create job alert

Databricks Engineer

London- hybrid- 3 days per week on-site

6 Months +

UMBRELLA only- Inside IR35

Key Responsibilities

Design, develop, and maintain ETL/ELT pipelines using Airflow for orchestration and scheduling.
Build and manage data transformation workflows in DBT running on Databricks.
Optimize data models in Delta Lake for performance, scalability, and cost efficiency.
Collaborate with analytics, BI, and data science teams to deliver clean, reliable datasets.
Implement data quality checks (dbt tests, monitoring) and ensure governance standards.
Manage and monitor Databricks clusters & SQL Warehouses to support workloads.
Contribute to CI/CD practices for data pipelines (version control, testing, deployments).
Troubleshoot pipeline failures, performance bottlenecks, and scaling challenges.
Document workflows, transformations, and data models for knowledge sharing.Required Skills & Qualifications

3-6 years of experience as a Data Engineer (or similar).
Hands-on expertise with:
DBT (dbt-core, dbt-databricks adapter, testing & documentation).
Apache Airflow (DAG design, operators, scheduling, dependencies).
Databricks (Spark, SQL, Delta Lake, job clusters, SQL Warehouses).
Strong SQL skills and understanding of data modeling (Kimball, Data Vault, or similar).
Proficiency in Python for scripting and pipeline development.
Experience with CI/CD tools (e.g., GitHub Actions, GitLab CI, Azure DevOps).
Familiarity with cloud platforms (AWS, Azure, or GCP).
Strong problem-solving skills and ability to work in cross-functional teams.

All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to respond to successful applicants in the first instance. We thank you for your interest and the time taken to apply

Related Jobs

View all jobs

Databricks Engineer

Databricks Engineer

Senior Data Engineer

Contract Databricks Platform Engineer - Remote - £525/pd

Integration Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Cloud Computing Recruitment Trends 2025 (UK): What Job Seekers Must Know About Today’s Hiring Process

Summary: UK cloud hiring has shifted from title-led CV screens to capability-driven assessments that emphasise platform reliability, cost control (FinOps), defence-in-depth security, automation via IaC, high-availability design, and measurable business impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for platform engineers, SREs, cloud security engineers, DevOps, solutions architects, FinOps practitioners & data/AI platform engineers. Who this is for: Cloud/platform engineers, SREs, DevOps, cloud security, FinOps, network engineers, solutions/enterprise architects, data/ML platform engineers, observability engineers & cloud product managers targeting roles in the UK.

Why Cloud Computing Careers in the UK Are Becoming More Multidisciplinary

For many years, cloud computing careers in the UK meant roles for infrastructure specialists, system administrators, network engineers & software developers. Today, the picture looks very different. Cloud has become the backbone of digital transformation across industries — from healthcare to finance, education to government. With that reach comes new expectations. Cloud isn’t just about servers & storage anymore. It’s about handling sensitive data responsibly, meeting regulatory obligations, designing intuitive user experiences, communicating clearly with diverse stakeholders & understanding how people actually interact with complex digital systems. This means cloud careers are increasingly multidisciplinary, requiring expertise in law, ethics, psychology, linguistics & design alongside technical skills. In this article, we’ll explore why cloud careers in the UK are broadening, how these five disciplines intersect with cloud work, what it means for job-seekers & employers, and how to future-proof your career in this fast-changing sector.

Cloud Computing Team Structures Explained: Who Does What in a Modern Cloud Department

Cloud computing has transformed how organisations in the UK and worldwide design, deliver, and maintain their IT infrastructure. Whether it’s migrating on-premise workloads to the cloud, building cloud-native applications, or optimising for cost, performance, and security — organisations of all sizes need cloud teams with clearly defined roles. For someone applying for cloud computing jobs, or hiring for them, knowing who does what in a modern cloud department gives you an edge. This article describes the core roles you’ll find in a mature cloud team, how these roles work together through the cloud lifecycle, what skills UK employers tend to expect, typical career paths and salaries, plus the challenges of structuring cloud computing teams.