Latest Data Streaming Jobs

Senior Data Analyst

Our client, a leading global SaaS organisation is looking for a Senior Data Analyst to work on exciting AI/ML user experience projects for a 12 month contract. Hybrid with 3 days on site.Responsibilities;* Providing data sources that help build the...

EF Recruitment Victoria, Greater London, London, SW1P 1BX, United Kingdom £500 pd

Databricks Data Architect

This role involves designing and implementing modern, cloud-native data platforms using Databricks and AWS, with a focus on data mesh principles and scalable data architectures. You'll lead the development of batch and real-time data pipelines, build Medallion Architecture-based data lakes, and enable self-service analytics for enterprise clients. The position emphasizes technical leadership in data engineering best practices and transformation from legacy systems to advanced cloud ecosystems.

Tenth Revolution Group London, United Kingdom £11,000 – £90,000 pa

Hybrid Permanent

Senior Manager Architect - Data

This role involves shaping the technical architecture of a cloud-based data ecosystem, focusing on distributed data processing, streaming, and data governance. The Senior Manager Architect will lead design decisions, drive innovation, and collaborate with engineering and data science teams to enable scalable data platforms for AI and ML. Based in London or Nottingham, the position emphasizes architectural excellence and cross-functional leadership in a hybrid work environment.

Capital One London, United Kingdom

Staff / Senior Software Engineer (Agentic Search) - Crawler

Design and build distributed, high-throughput crawling and ingestion systems to acquire and refresh content from the open web at scale. Develop low-latency, observable data pipelines for AI-native search, ensuring freshness, coverage, and reliability. Collaborate with indexing and ML teams to support programmatic search APIs grounded in real-world data.

Nebius United Kingdom

Principal Data Engineer - Azure - Perm

Principal Data Engineer (Azure)We're looking for an experiencedPrincipal Data Engineer to lead the technical direction of a modern Azure-based data platform. This is a hands-on leadership role where you'll shape data engineering standards, design scalable lakehouse architectures, and drive innovation...

Lorien Glasgow, Alba / Scotland, G2 1AL, United Kingdom £54,000 – £70,000 pa

Senior Data Engineer

Design and build scalable data pipelines and platforms to support analytics, business intelligence, and data-driven products across a growing AI cloud company. Focus on data modeling, pipeline reliability, and system observability while collaborating with product and business teams. Work in a fast-paced environment with ownership over architecture and operational health of critical data systems.

Nebius United Kingdom

DV Cleared Data Engineer

Job Title: DV Cleared Data EngineerLocation: BathDuration: 12 monthsRate: Up to £500 per dayMust be willing and eligible to go through the DV clearance processOur client, a reputable organisation supporting high-profile government programmes, is hiring a DV Cleared Data Engineer...

Experis Bath, Somerset, United Kingdom £400 – £500 pd

Senior Databricks Data Engineer - London

This role involves designing, building, and optimizing production-grade data pipelines using Databricks, Spark, and Delta Lake. You will work closely with Data Scientists, Analysts, and Product teams to deliver high-quality data products and contribute to engineering standards and platform optimization.

Tenth Revolution Group Richmond, United Kingdom £80,000 – £85,000 pa

Senior Solutions Architect (EDW Enterprise Data Warehouse Migrations)

This role focuses on leading enterprise data warehouse (EDW) migrations to the Databricks Lakehouse platform across EMEA. The Senior Solutions Architect will design technical go-to-market strategies, develop scalable migration frameworks, and act as a top-tier technical resource for complex customer transitions. They will also mentor regional teams, contribute to product development through customer insights, and establish thought leadership through technical content and public speaking.

Databricks London, United Kingdom

Full Stack Data Engineer

This role involves building and maintaining scalable data platforms, developing APIs, and working on cloud-native microservices. You will work across the full technology stack, including Node.js, JavaScript, TypeScript, Python, and Kubernetes, in a DevOps environment. The position offers a remote-first policy and the chance to work on high-impact projects.

SF Partners Scotland, United Kingdom £90,000 – £100,000 pa

System Engineer, Messaging and Streaming Team

This role involves working with the Messaging and Streaming Team at AWS, focusing on building and supporting services like Kinesis Data Streams, SQS, and SNS. Responsibilities include proactive problem-solving, automation, and maintaining documentation. The team values diverse experiences and offers mentorship and work-life balance.

Amazon.com, Inc Oxford, United Kingdom

On-site Permanent

Sr. Solutions Engineer

This role involves partnering with sales teams to win new digital-native customers by conducting technical evaluations and proofs-of-concept using real data and workloads. The Senior Solutions Engineer will engage directly with technical buyers, demonstrating Databricks' Data Intelligence Platform across data engineering, machine learning, and Generative AI use cases. The position emphasizes hands-on problem solving, integration with existing cloud and open-source stacks, and active participation in technical communities through workshops and hackathons.

Databricks London, United Kingdom

SC cleared GCP Cloud engineer

This role involves designing, deploying, and managing secure cloud infrastructure on Google Cloud Platform, with a strong focus on containerised workloads using Kubernetes and Docker. The engineer will apply infrastructure-as-code practices using tools like Terraform or Ansible and implement CI/CD pipelines in a highly regulated environment requiring SC clearance. Responsibilities include ensuring hardened, compliant deployments and supporting scalable data or machine learning platforms.

Opus Recruitment Solutions London, United Kingdom £450 – £500 pd

Senior Cloud Engineer - SC Cleared

Design and operate secure, resilient cloud infrastructure on Google Cloud for regulated and air-gapped environments, focusing on a split topology with edge and central Kubernetes clusters. Implement infrastructure as code, CI/CD, observability, and security hardening across distributed systems under accreditation scrutiny. Work autonomously within a small, delivery-driven team building AI platforms for high-stakes government and commercial programmes.

VIQU IT London, United Kingdom £400 – £500 pd

Remote Contract Clearance Required

Software Engineer - Backend Developer

Backend Software EngineerManchester - 2 days in the office6 Months Contract + Extension£72.00 per hourA global e-commerce product organisation is urgently looking for experienced Backend Engineers to help lay the technical groundwork for scaling global partner connectivity across our travel...

Randstad Technologies Recruitment Manchester, United Kingdom £70 – £72 ph