Senior Data Engineer - Databricks - London (Hybrid) - Up to £80,000
We're partnering with a fast-growing analytics and data business operating across the entertainment sector. As demand for real-time insight and advanced analytics continues to scale, the company is investing heavily in a modern, cloud-native data platform, with Databricks at its core.
This role is ideal for a Senior Data Engineer who wants true end-to-end ownership: designing, building, deploying and operating production-grade data systems, while shaping engineering standards and CI/CD practices across the platform.
The Role
You'll play a key role in building and evolving a high-performance Databricks lakehouse platform, taking ownership from ingestion through to production deployment.
Key responsibilities include:
- Design, build and operate end-to-end data pipelines using Databricks
- Own and evolve Databricks architecture across batch, streaming and event-driven workloads
- Implement and mature CI/CD pipelines for data engineering (testing, deployment, versioning)
- Develop reusable, production-ready data frameworks and patterns
- Drive engineering best practice across performance, security, reliability and cost optimisation
- Lead technical design decisions and influence long-term data platform strategy
- Mentor other engineers and raise overall data engineering standards
This is a hands-on role with genuine architectural influence, not a people-management-only position.
Key Experience & Capabilities
We're specifically looking for strength in modern data engineering, not just analytics or reporting.
Core requirements:
- Strong experience delivering end-to-end data engineering solutions in production
- Deep hands-on expertise with Databricks (jobs, notebooks, workflows, Delta Lake)
- Experience designing and operating CI/CD pipelines for data platforms
- Strong Python & SQL skills for scalable data processing
- Solid understanding of lakehouse architecture and the Medallion (Bronze/Silver/Gold) pattern
- Strong data modelling experience (star/snowflake schemas, SCD Types 1-3)
- Experience with streaming and event-driven architectures
- Performance tuning and cost optimisation in cloud data platforms
- Experience with data quality, observability and data contracts
Nice to have (but not essential):
- dbt, Snowflake or similar analytics engineering tooling
- Experience supporting ML or advanced analytics workloads
- Exposure to data mesh or domain-oriented data platforms
What's on Offer
- Up to £80,000 salary
- Join a scaling, well-funded business with serious technical ambition
- Work on a modern Databricks-centric data platform
- High impact role with ownership of architecture, CI/CD and engineering standards
- Clear opportunity to influence how data engineering is done across the organisation
Interested
If you're a Senior Data Engineer who wants real ownership of Databricks, end-to-end pipelines and shape a modern data platform from the ground up.
Apply Now!
:quality(80))
:quality(80))
:quality(80))