Senior Data Engineer

Spitalfields and Banglatown
2 days ago
Create job alert

We believe in better. And we make it happen.
Better content. Better products. And better careers.
Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise and innovate. We turn big ideas into the products, content and services millions of people love.
And we do it all right here at Sky.

Within the Communications & Infrastructure group, RTA ( Real-Time Analytics ) is a platform that offers every team and every individual in Sky Technology a managed service of Sky's Telco telemetry data assets and enables data anal ytics at scale.

We are looking for a promising and seasoned Sr. Data Engineer who will act as a technical leader within the data engineering team, shaping the future of our data platform and enabling data-driven decision-making across the organisation.

This role goes beyond coding- it's about influencing strategy, fostering collaboration, and driving excellence in data lifecycle management.

What you'll do Lead technical decisions and shape the data platform's long-term vision for efficiency, scalability, and compliance.

Define and deliver the data platform roadmap, collaborating with stakeholders to align with business objectives .

Oversee and contribute to the end-to-end delivery of data processing capabilities - including design, development, and support - with a distributed team.

Drive continuous improvement in ways of working and foster innovation by exploring new technologies and methodologies.

Implement robust data lifecycle management and automation to ensure data quality, security, accessibility, and compliance.

What you'll bring Graduate degree (BSc) in Computer Science, Electrical Engineering, or related field, coupled with extensive experience in data engineering.

Cloud & Infrastructure-as-Code: Deep expertise in architecting on major cloud platforms (GCP/AWS) using Terraform for infrastructure automation and Git for robust version control and CI/CD workflows.

Big Data Processing & Engineering: Advanced proficiency in Python and SQL to build scalable batch and streaming ETL/ELT pipelines using distributed frameworks like Spark or Beam.

Data Architecture & Storage: Extensive experience managing diverse data ecosystems, including Relational/NoSQL databases, high-performance Data Warehouses, and complex storage for structured and unstructured data

Data Governance & Security: Hands-on experience implementing data quality frameworks, security protocols, and full data lifecycle management.

Proven ability to lead and motivate teams in dynamic environments, ideally in Telecom or similar industries where software is always-on and customer experience is critical.

Collaborative Problem Solving: A "lead by influence" mindset that values diverse perspectives and proactively removes roadblocks to ensure team success.

Adaptability in High-Stakes Environments: Proven resilience in dynamic, "always-on" industries (like Telecom), where system uptime and customer experience are mission-critical.

Technology Stack Apache Airflow / Kafka

GCP ( BigQuery , GCS, Composer, IAM)

Python

Terraform

Linux / Bash

Team overview

Looking to be part of non-stop innovation? Join our Group Communications and Infrastructure team and you'll work alongside experts in broadband, telephony, mobile, cloud and infrastructure. We're the team that designs, builds, supports and maintains the telecoms networks across the whole Sky Group. Together, we help Sky broadband, mobile and TV enter new markets by creating a single and secure infrastructure for the amazing content and services that keep our customers coming back for more.

The rewards

There's one thing people can't stop talking about when it comes to #LifeAtSky: the perks. Here's a taster: Sky Q, for the TV you love all in one place

The magic of Sky Glass at an exclusive rate

A generous pension package

Private healthcare

Discounted mobile and broadband

A wide range of Sky VIP rewards and experiences

Inclusion & how you'll work

We are a Disability Confident Employer, and welcome and encourage applications from all candidates. We will look to ensure a fair and consistent experience for all, and will make reasonable adjustments to support you where" appropriate . Please flag any adjustments you need to your recruiter as early as you can.

We've "embraced hybrid working and split our time between unique office spaces and the convenience of working from home. You'll find out more about what hybrid working looks like for your role later in the recruitment process.

Your office space

Brick Lane

Our Brick Lane office is in the heart of the East End of London. It's part of a vibrant and varied community; close to street food, cafes, and shops.

The closest tube station is Aldgate East and Liverpool Street is about a 10-minute walk.

We'd love to hear from you

Inventive, forward-thinking minds come together to work in Tech, Product and Data at Sky. It's a place where you can explore what if, how far, and what next.

But better doesn't stop at what we do, it's how we do it, too. We embrace each other's differences. We support our community and contribute to a sustainable future for our business and the planet.

If you believe in better, we'll back you all the way.

Just so you know: if your application is successful, we'll ask you to complete a criminal record check. And depending on the role you have applied for and the nature of any convictions you may have, we might have to withdraw the offer

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer x1/ Data Engineer x1 (Financial Services)

Senior Data Engineer - Azure | Permanent | Hybrid

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Maths for Cloud Jobs: The Only Topics You Actually Need (& How to Learn Them)

If you are applying for cloud computing jobs in the UK you might have noticed something frustrating: job descriptions rarely ask for “maths” directly yet interviews often drift into capacity, performance, reliability, cost or security trade-offs that are maths in practice. The good news is you do not need degree-level theory to be job-ready. For most roles like Cloud Engineer, DevOps Engineer, Platform Engineer, SRE, Cloud Architect, FinOps Analyst or Cloud Security Engineer you keep coming back to a small set of practical skills: Units, rates & back-of-the-envelope estimation (requests per second, throughput, latency, storage growth) Statistics for reliability & observability (percentiles, error rates, SLOs, error budgets) Capacity planning & queueing intuition (utilisation, saturation, Little’s Law) Cost modelling & optimisation (right-sizing, break-even thinking, cost per transaction) Trade-off reasoning under constraints (performance vs cost vs reliability) This guide explains exactly what to learn plus a 6-week plan & portfolio projects you can publish to prove it.

Neurodiversity in Cloud Computing Careers: Turning Different Thinking into a Superpower

Cloud computing sits at the heart of modern tech. Almost every digital product runs on someone’s cloud platform – from banking apps & streaming services to AI tools & online shops. Behind those platforms are teams of cloud engineers, architects, SREs, security specialists & more. These roles demand problem-solvers who can think in systems, spot patterns, stay calm under pressure & imagine better ways to build & run infrastructure. That makes cloud computing a natural fit for many neurodivergent people – including those with ADHD, autism & dyslexia. If you are neurodivergent & considering a cloud career, you might have heard messages like “you’re too distracted for engineering”, “too literal for stakeholder work” or “too disorganised for operations”. In reality, many traits that come with ADHD, autism & dyslexia are exactly what cloud teams need. This guide is written for cloud computing job seekers in the UK. We will cover: What neurodiversity means in a cloud context How ADHD, autism & dyslexia strengths map to cloud roles Practical workplace adjustments you can ask for under UK law How to talk about neurodivergence in applications & interviews By the end, you should have a clearer sense of where you might thrive in cloud computing – & how to turn “different thinking” into a professional superpower.

Cloud Computing Hiring Trends 2026: What to Watch Out For (For Job Seekers & Recruiters)

As we move into 2026, the cloud computing jobs market in the UK is shifting again. The era of “lift & shift everything to the cloud” is giving way to a more mature, cost-conscious & security-focused phase. Many organisations are tightening budgets, some are rationalising cloud spend, yet demand for strong cloud talent remains high – especially around multi-cloud, FinOps, cloud security, data platforms & AI on cloud. Vendors are racing to integrate generative AI into their offerings, enterprises are modernising legacy estates, & regulators are asking tougher questions about resilience, sovereignty & risk. At the same time, some roles are being automated or commoditised, & the bar for cloud roles keeps rising. Whether you are a cloud job seeker planning your next move, or a recruiter building cloud teams, understanding the key cloud computing hiring trends for 2026 will help you stay ahead.