Senior Data Engineer

Senior Data Engineer

Location: 100% Remote (UK-based)

Employment Type: Permanent

Salary: Up to £75,000

Positions Available: 2

The Opportunity

We’re looking for two experienced Senior Data Engineers to join a growing data platform team delivering modern cloud-native data solutions at scale.

This role is ideal for self-starters who enjoy autonomy, ownership, and solving complex engineering challenges within a highly collaborative environment.

The core technology stack is Databricks on AWS, and candidates must have strong hands-on experience specifically with Databricks deployed in AWS environments. Experience with Databricks on other cloud platforms alone will not be sufficient, as the implementation approach and tooling differ significantly.

You’ll play a key role in designing and building scalable, governed, and high-performing data solutions across the full data engineering lifecycle.

Key Responsibilities

• Design and develop scalable ETL/ELT pipelines using Databricks, Python, SQL, and Spark

• Build and optimise Delta Lake architectures and data pipelines on AWS

• Implement ingestion frameworks using Databricks Autoloader

• Develop transformation workflows using Lakeflow / Delta Live Tables

• Work with Data Asset Bundles for deployment and environment management

• Support CI/CD and infrastructure automation across the data platform

• Ensure data quality, governance, lineage, and observability best practices

• Optimise cluster performance, orchestration, and cost efficiency

• Collaborate with architects, analysts, and wider engineering teams

• Contribute to platform standards, reusable frameworks, and engineering best practices

Essential Skills & Experience

• Strong commercial experience as a Senior Data Engineer

• Proven expertise with Databricks on AWS (essential)

• Strong understanding of Spark, Delta Lake, and Lakehouse architecture

• Hands-on experience with Databricks Autoloader and Lakeflow / DLT

• Experience using Data Asset Bundles within Databricks environments

• Strong AWS experience across modern cloud-native data platforms

• Good understanding of the full data engineering lifecycle

• Experience building scalable, maintainable, and production-grade data solutions

• Strong communication and stakeholder engagement skills

• Comfortable working independently with high levels of ownership and autonomy

Nice to Have

• CI/CD and Infrastructure as Code experience

• Experience with governance and metadata tooling

• Exposure to data observability and monitoring frameworks

• Previous experience working in fast-paced agile delivery environments

This is an excellent opportunity to join a modern engineering environment where you’ll have genuine influence over platform direction, architecture, and engineering standards.