Latest Data Streaming Jobs

Senior Software Engineer

As a Senior Software Engineer, you will work on the Tableflow project, developing and maintaining a multi-tenant, highly available compute infrastructure for Kora's storage solutions. You will focus on table materialization, compaction, and background maintenance, ensuring high availability and scalability across Confluent Cloud.

Confluent United Kingdom

Remote Permanent

Staff Software Engineer I

This role involves developing core components of a next-generation multi-modal storage engine, focusing on scalable table materialization, compaction, and highly available compute infrastructure for streaming data. The engineer will solve complex distributed systems challenges within the Tableflow project, enabling seamless consumption of data as both stream and table. Work includes platform optimization and cross-team collaboration to integrate storage solutions at scale.

Confluent United Kingdom

Remote Permanent

SC cleared GCP Cloud engineer

This role involves designing, deploying, and managing secure cloud infrastructure on Google Cloud Platform, with a strong focus on containerised workloads using Kubernetes and Docker. The engineer will apply infrastructure-as-code practices using tools like Terraform or Ansible and implement CI/CD pipelines in a highly regulated environment requiring SC clearance. Responsibilities include ensuring hardened, compliant deployments and supporting scalable data or machine learning platforms.

Opus Recruitment Solutions London, United Kingdom £450 – £500 pd

Senior Java Developer

This role involves designing and building distributed services from the ground up using core Java, with a focus on event-driven systems powered by Kafka and stream-processing frameworks. You'll work on scalable backend systems that ingest and transform large volumes of data, deploy and manage services on Kubernetes, and solve complex challenges in data consistency and availability. The role also includes mentoring team members and contributing to the evolution of a globally used observability platform.

hireful London, United Kingdom £90,000 – £110,000 pa

Hybrid Permanent

IAM Devops

This role involves designing and maintaining secure, scalable infrastructure with a focus on identity and access management (IAM) within a DevOps environment. The engineer will work extensively with Terraform and GCP for infrastructure automation, manage containerized workloads on GKE, and implement CI/CD pipelines with strong DevSecOps practices. Key responsibilities include ensuring compliance, regionalisation, and secure identity governance across global systems while supporting Kafka and Neo4j-based data platforms.

Vallum Associates Sheffield, South Yorkshire, United Kingdom £430 – £500 pd

Hybrid Contract Clearance Required

Senior Databricks Architect

This role involves designing and delivering enterprise-scale data platforms using Databricks and AWS, with a focus on modern data architectures like lakehouse and Medallion principles. The architect will build batch and real-time data pipelines, develop scalable data products, and lead technical strategy for large cloud transformation programmes. Emphasis is placed on data governance, security, and collaboration across engineering and business teams.

Tenth Revolution Group London, United Kingdom £85,000 – £115,000 pa

Hybrid Permanent

AI Deployment Engineer

This role involves building and maintaining the infrastructure that supports AI deployment, focusing on data pipelines, system integrations, and production-grade reliability. The engineer will take AI prototypes from concept to scalable, robust systems integrated with CRMs, ERPs, and SaaS platforms. Emphasis is on automation, data integrity, and seamless communication between AI agents and enterprise systems.

Emponics Almondsbury, Gloucestershire, BS32 4DS, United Kingdom £80,000 – £130,000 pa

Hybrid Permanent

Senior Java Engineer

This role involves designing and building distributed services from the ground up using core Java, with a focus on high-scale data processing and event-driven systems. You'll work on Kubernetes-based deployments, tackle challenges in data consistency and availability, and contribute to a platform used globally. The role offers technical ownership, mentorship opportunities, and collaboration within a skilled engineering team.

hireful London, United Kingdom £120,000 – £130,000 pa

Hybrid Permanent

AI Deployment Engineer

Design and maintain the data infrastructure and system integrations that support AI deployments, taking prototypes to production-grade systems. Build and manage data pipelines, APIs, and middleware to connect AI agents with business systems like CRMs and ERPs. Ensure reliability, scalability, and monitoring across deployed AI solutions in a hybrid cloud environment.

Emponics Cornhill, Greater London, City And County Of the City Of London, United Kingdom £100,000 – £130,000 pa

AI Platform Architect

Design and lead the architecture of enterprise-scale AI platforms for a major financial services client, focusing on cloud-native solutions on GCP. Drive MLOps, LLMOps, and AgentOps best practices, ensuring secure, governed, and production-ready AI systems that meet strict financial regulatory requirements. Collaborate across engineering, data, and business teams to deliver scalable AI solutions spanning traditional machine learning and generative AI.

83zero London, United Kingdom £90,000 – £100,000 pa

Hybrid Permanent

Senior Machine Learning Engineer, Developer Advocacy | UK |

This role involves building and evolving a real-time, personalized recommendation system for Grafana's in-product interactive learning experience. The engineer will develop, deploy, and operate machine learning models that improve user engagement by suggesting relevant guides and actions based on product usage and context. The position emphasizes iterative development, close collaboration with software engineers and data analysts, and ownership of the full model lifecycle within a remote-first, open-source-driven culture.

Grafana Labs United Kingdom £91,755 – £110,106 pa

Remote Permanent

Senior Solution Engineer - Global Accounts

This role involves serving as the primary technical advisor for a major financial services client at Snowflake, focusing on expanding use of the platform across risk analytics, regulatory reporting, fraud detection, and AI/ML workloads. The engineer will design and deliver solution architectures, lead proof-of-concept projects, and collaborate with internal teams to drive adoption. The position emphasizes deep technical engagement with senior stakeholders and requires expertise in cloud data platforms within highly regulated financial environments.

Snowflake London, United Kingdom

Hybrid Permanent

Principal Engineer – Risk Decisioning & Agentic AI – BPL

Job DescriptionPurpose of the roleTo drive technical excellence and innovation by leading the design and implementation of robust software solutions, providing mentorship to engineering teams, fostering cross-functional collaboration, and contributing to strategic planning to ensure the delivery of high-quality solutions...

Barclays London, E14 5RB, United Kingdom

Data Engineer (Full-Stack Data Products)

Design and build scalable data pipelines and platforms that support analytics and AI-driven products, integrating data from diverse sources. Develop production-grade applications and APIs while ensuring data reliability and quality. Work with cloud infrastructure and modern DevOps practices to deliver robust, automated data solutions.

Catalyst Newcastle upon Tyne, Tyne & Wear, United Kingdom

Data Engineer (Full-Stack Data Products)

The ClientWe are delighted to be ,once more, recruiting on behalf of our prestigious client, a newly created JV Technology Consulting business formed by global leaders in the fields of management consulting and investment fund management. Based in Newcastle upon...

Catalyst Ne11Ad, NE1 1AD, United Kingdom