Senior Data Engineer

£72,000 GBP

Hybrid WORKING

Location: Central London, Greater London - United Kingdom Type: Permanent

The Opportunity

A leading technology and digital intelligence organisation is seeking an experienced Senior Data Engineer to design, develop and maintain data engineering solutions supporting complex client requirements, including work within the National Security and public sector environments.

The successful candidate will combine strong technical data engineering expertise with the ability to lead engineering teams, engage with stakeholders and translate business requirements into effective, scalable data solutions.

Working alongside data architects, data scientists, analysts and wider technical teams, the Senior Data Engineer will help organisations extract, transform, store and deliver data for downstream consumption, enabling informed decision-making and improved business outcomes.

This is an opportunity for a technically accomplished data professional to take ownership of engineering delivery, shape data platforms and contribute to the development of modern data engineering practices.

Key Responsibilities

As a Senior Data Engineer, the successful candidate will:

• Design, build, improve and maintain data pipelines and ETL processes to extract, transform and load data.
• Develop and deploy high-quality data engineering components using software engineering and DataOps best practices.
• Work closely with clients and business stakeholders to understand requirements and translate business problems into technical solutions.
• Collaborate with data architects, data scientists, analysts and other engineering teams to deliver effective data flows.
• Develop and maintain cloud-based data infrastructure and services to host and store data.
• Apply data management, orchestration, security and data modelling principles across engineering solutions.
• Communicate technical concepts clearly to technical and non-technical stakeholders.
• Build strong working relationships across teams and organisational functions.
• Adapt to evolving data engineering tools, technologies and techniques.
• Lead data engineering teams from a technical perspective, establishing delivery frameworks that support effective execution.
• Engage business stakeholders to define work packages, establish priorities and build appropriately skilled teams.
• Lead technical design sessions and contribute to the selection of strategic data products for data engineering platforms.
• Develop broader expertise across data architecture, data strategy, data science, data modelling and analytics.
• Demonstrate increasing technical depth and breadth across a range of data engineering products and technologies.

Essential Skills & Experience

The ideal candidate will have strong data engineering experience, combining hands-on technical capability with leadership and stakeholder engagement skills.

Key requirements include:

• Strong programming skills in Python, SQL or similar programming languages.
• Extensive experience with AWS
• Experience building, maintaining and optimising data pipelines and ETL processes.
• Understanding of data engineering principles, data management and data modelling.
• Experience with data orchestration and the development of reliable data workflows.
• Experience establishing or working with cloud services to host data infrastructure and store data.
• Knowledge of data security and the principles required to manage data effectively.
• Experience applying software engineering practices to data development and deployment.
• The ability to understand business requirements and translate them into effective engineering solutions.
• Strong communication skills, with the ability to engage technical and non-technical stakeholders.
• Experience collaborating across multidisciplinary teams.
• The ability to learn new technologies quickly and adapt to changing client requirements.

Senior-Level Technical Leadership

In addition to hands-on engineering expertise, candidates should demonstrate the ability to lead technical delivery and support the development of wider data engineering capabilities.

Relevant experience includes:

• Providing technical leadership to data engineering teams.
• Establishing delivery frameworks and engineering practices.
• Leading technical design discussions and influencing technology selection.
• Defining work packages in collaboration with business stakeholders.
• Building effective teams and supporting collaboration across data disciplines.
• Developing expertise across data architecture, strategy, modelling and analytics.
• Balancing technical considerations with business requirements and delivery objectives.

Cloud Data Engineering & Data Platforms

The role involves configuring cloud services to support data infrastructure and storage requirements.

Candidates should understand how data is collected, processed, stored and made available to downstream consumers. The ability to work across different data engineering tools and platforms, assess technical options and select appropriate solutions for client requirements will be important.

Experience with modern data engineering approaches, orchestration, cloud infrastructure and DataOps practices will be particularly relevant.

National Security & Public Sector

The successful candidate will join a technology team delivering solutions across demanding client environments, with opportunities to contribute to National Security, security and law enforcement, and wider public sector programmes.

The role offers exposure to complex data challenges and the opportunity to work with multidisciplinary teams developing high-quality technical solutions.

Candidates must be comfortable working collaboratively, understanding client needs and delivering data engineering outcomes within environments where technical quality and effective delivery are essential.

Security Clearance

Security Clearance is required for this position.

Candidates who do not currently hold the required clearance must be eligible to obtain it and willing to undergo the relevant clearance process.