SC Cleared Databricks Data Engineer - Hybrid - Outside IR35

Newcastle upon Tyne

2 weeks ago

Applications closed

Related Jobs

View all jobs

SC Cleared Senior AWS Cloud Engineer

SC Cleared HPC Containerization Expert

Java Developer - SC Cleared

Network Engineer - SC Cleared - Farnborough

Infrastructure Engineer - SC Cleared - Cambridgeshire

Salesforce DevOps Engineer SC Cleared

SC Cleared Databricks Data Engineer - Hybrid - Outside IR35

We are seeking a skilled Databricks Data Engineer to design, build, and optimize scalable data pipelines and analytics platforms. In this role, you will work closely with data scientists, analysts, and product teams to deliver reliable, high-performance data solutions using Databricks and modern cloud technologies.

Key Responsibilities

Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, and Delta Lake

Build and optimize ETL/ELT workflows for batch and streaming data

Develop data models to support analytics, reporting, and machine learning use cases

Ensure data quality, reliability, and performance across data platforms

Integrate data from multiple sources including APIs, databases, and cloud storage

Collaborate with data scientists and analysts to enable advanced analytics and ML workloads

Implement monitoring, logging, and cost-optimization best practices

Follow data governance, security, and compliance standards

Document data pipelines, architectures, and best practices

Required Qualifications

3+ years of experience in data engineering or a similar role

Strong experience with Databricks and Apache Spark

Proficiency in Python and SQL

Experience with Delta Lake, data modeling, and performance tuning

Hands-on experience with cloud platforms (AWS, Azure, or GCP)

Familiarity with data orchestration tools (e.g., Airflow, Azure Data Factory)

Solid understanding of data warehousing and big data concepts

Preferred Qualifications

Experience with real-time/streaming data (Spark Structured Streaming, Kafka, etc.)

Knowledge of CI/CD for data pipelines

Experience supporting machine learning pipelines

Databricks or cloud platform certifications

To apply for this role please submit your CV or contact Dillon Blackburn on (phone number removed) or at (url removed).

Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Feb 9, 2026

Careers

How Many Cloud Computing Tools Do You Need to Know to Get a Cloud Job?

If you are aiming for a role in cloud computing, it can feel like the skills list never ends. One job advert asks for AWS, Terraform and Kubernetes. Another mentions Azure DevOps, PowerShell and ARM templates. A third throws in Docker, Python, Linux, CI/CD, monitoring tools and security frameworks. It is no surprise that many cloud job seekers feel overwhelmed before they even apply. Here is the reality most cloud hiring managers agree on: they are not hiring you because you know every cloud tool. They are hiring you because you understand cloud concepts, can design reliable systems, manage costs, keep things secure and support real workloads. Tools matter, but only when they support outcomes. So how many cloud computing tools do you actually need to know to get a job? For most roles, the answer is far fewer than you think. This article explains what employers really expect, which tools are essential, which are role-specific, and how to focus your learning so you look capable and employable rather than scattered.

Feb 2, 2026

Jobs

What Hiring Managers Look for First in Cloud Computing Job Applications (UK Guide)

anding a job in cloud computing can be highly competitive — especially in the UK market where demand far outpaces supply in many segments. Whether you’re aiming for roles in Cloud Engineering, DevOps, Site Reliability, Cloud Architecture, Security, Data/Analytics, or Platform Operations, hiring managers screen applications quickly and with specific priorities in mind. Hiring managers don’t read every detail at first; they scan for critical signals in the first 10–20 seconds. These early signals determine whether your CV gets read more closely, whether your LinkedIn profile gets clicked, and whether you’re invited to interview. This guide breaks down, in practical terms, exactly what hiring managers look for first in cloud computing applications — and what you should emphasise in your CV, cover letter and portfolio to stand out on www.cloudcomputingjobs.co.uk .

Jan 23, 2026

Education

The Skills Gap in Cloud Computing Jobs: What Universities Aren’t Teaching

Cloud computing underpins almost every modern digital service. From financial systems and healthcare platforms to AI, e-commerce, government infrastructure and cybersecurity, the cloud is now the default operating environment for UK organisations. Demand for cloud professionals has grown rapidly, with roles spanning architecture, engineering, security, DevOps, platform operations and cost optimisation. Salaries remain high, and vacancies remain stubbornly difficult to fill. Yet despite a growing number of graduates with computer science, IT and software engineering degrees, employers across the UK report a persistent problem: Too many candidates are not job-ready for real cloud computing roles. This is not a question of intelligence or motivation. It is a structural skills gap between what universities teach and what cloud jobs actually require. This article explores that gap in depth: what universities do well, what they consistently miss, why the gap exists, what employers genuinely want, and how jobseekers can bridge the divide to build sustainable careers in cloud computing.