Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

PySpark Developer

London
2 weeks ago
Create job alert

We are looking for an experienced PySpark Developer with strong Microsoft Fabric and Azure engineering skills to join a major transformation programme within the financial-markets domain. This role is fully hands-on, focused on building and optimising large-scale data pipelines, dataflows, semantic models, and lakehouse components.
Key Responsibilities

  • Design, build and optimise Spark-based data pipelines for batch and streaming workloads
  • Develop Fabric dataflows, pipelines, and semantic models
  • Implement complex transformations, joins, aggregations and performance tuning
  • Build and optimise Delta Lake / delta tables
  • Develop secure data solutions including role-based access, data masking and compliance controls
  • Implement data validation, cleansing, profiling and documentation
  • Work closely with analysts and stakeholders to translate requirements into scalable technical solutions
  • Troubleshoot and improve reliability, latency and workload performance
    Essential Skills
  • Strong hands-on experience with PySpark, Spark SQL, Spark Streaming, DataFrames
  • Microsoft Fabric (Fabric Spark jobs, dataflows, pipelines, semantic models)
  • Azure: ADLS, cloud data engineering, notebooks
  • Python programming; Java exposure beneficial
  • Delta Lake / Delta table optimisation experience
  • Git / GitLab, CI/CD pipelines, DevOps practices
  • Strong troubleshooting and problem-solving ability
  • Experience with lakehouse architectures, ETL workflows, and distributed computing
  • Familiarity with time-series, market data, transactional data or risk metrics
    Nice to Have
  • Power BI dataset preparation
  • OneLake, Azure Data Lake, Kubernetes, Docker
  • Knowledge of financial regulations (GDPR, SOX)
    Details
  • Location: London (office-based)
  • Type: Contract
  • Duration: 6 months
  • Start: ASAP
  • Rate: Market rates
    If you are a PySpark / Fabric / Azure Data Engineer looking for a high-impact contract role, apply now for immediate consideration

Related Jobs

View all jobs

Azure Databricks Engineer - Contract

Data Engineer (Python)

Fabric Data Engineer - Hybrid - 75k - Winchester

Azure Data Engineer - £400PD - Remote

Python Data Engineer

Databricks Engineer - £400PD - Remote

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Jobs

Cloud Computing Hiring Trends 2026: What to Watch Out For (For Job Seekers & Recruiters)

As we move into 2026, the cloud computing jobs market in the UK is shifting again. The era of “lift & shift everything to the cloud” is giving way to a more mature, cost-conscious & security-focused phase. Many organisations are tightening budgets, some are rationalising cloud spend, yet demand for strong cloud talent remains high – especially around multi-cloud, FinOps, cloud security, data platforms & AI on cloud. Vendors are racing to integrate generative AI into their offerings, enterprises are modernising legacy estates, & regulators are asking tougher questions about resilience, sovereignty & risk. At the same time, some roles are being automated or commoditised, & the bar for cloud roles keeps rising. Whether you are a cloud job seeker planning your next move, or a recruiter building cloud teams, understanding the key cloud computing hiring trends for 2026 will help you stay ahead.

Jobs

Cloud Computing Recruitment Trends 2025 (UK): What Job Seekers Must Know About Today’s Hiring Process

Summary: UK cloud hiring has shifted from title-led CV screens to capability-driven assessments that emphasise platform reliability, cost control (FinOps), defence-in-depth security, automation via IaC, high-availability design, and measurable business impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for platform engineers, SREs, cloud security engineers, DevOps, solutions architects, FinOps practitioners & data/AI platform engineers. Who this is for: Cloud/platform engineers, SREs, DevOps, cloud security, FinOps, network engineers, solutions/enterprise architects, data/ML platform engineers, observability engineers & cloud product managers targeting roles in the UK.

Jobs

Why Cloud Computing Careers in the UK Are Becoming More Multidisciplinary

For many years, cloud computing careers in the UK meant roles for infrastructure specialists, system administrators, network engineers & software developers. Today, the picture looks very different. Cloud has become the backbone of digital transformation across industries — from healthcare to finance, education to government. With that reach comes new expectations. Cloud isn’t just about servers & storage anymore. It’s about handling sensitive data responsibly, meeting regulatory obligations, designing intuitive user experiences, communicating clearly with diverse stakeholders & understanding how people actually interact with complex digital systems. This means cloud careers are increasingly multidisciplinary, requiring expertise in law, ethics, psychology, linguistics & design alongside technical skills. In this article, we’ll explore why cloud careers in the UK are broadening, how these five disciplines intersect with cloud work, what it means for job-seekers & employers, and how to future-proof your career in this fast-changing sector.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.