AWS Data Engineer

Senior Data Engineer - London (Hybrid 3 to 4 days)

Type: Full-time
Location: London, UK

Help Build the Future of Data in Financial Services

A leading financial services client is growing its data engineering team and is looking for experienced engineers who are passionate about building scalable, high-quality data systems. This is an opportunity to work on globally impactful products in a modern cloud environment, alongside a collaborative team that values clean code, continuous learning, and strong engineering principles.

What You'll Be Doing

You'll be a key contributor to the development of a next-generation data platform, with responsibilities including:

Designing and implementing scalable data pipelines using Python and Apache Spark
Building and orchestrating workflows using AWS services such as Glue, Lambda, S3, and EMR Serverless
Applying best practices in software engineering: CI/CD, version control, automated testing, and modular design
Supporting the development of a lakehouse architecture using Apache Iceberg
Collaborating with product and business teams to deliver data-driven solutions
Embedding observability and quality checks into data workflows
Participating in code reviews, pair programming, and architectural discussions
Gaining domain knowledge in financial data and sharing insights with the team

What They're Looking For

Core Requirements

Proficiency in Python, with a focus on clean, maintainable code (bonus for experience with type hints, linters, and testing frameworks like pytest)
Solid understanding of data engineering fundamentals: ETL/ELT, schema evolution, batch processing
Experience or strong interest in Apache Spark for distributed data processing
Familiarity with AWS data tools (e.g., S3, Glue, Lambda, EMR)
Strong communication skills and a collaborative mindset
Comfortable working in Agile environments and engaging with stakeholders

Bonus Skills

Experience with Apache Iceberg or similar table formats (e.g., Delta Lake, Hudi)
Exposure to CI/CD tools like GitHub Actions, GitLab CI, or Jenkins
Familiarity with data quality frameworks such as Great Expectations or Deequ
Interest in financial markets, investment analytics, or index data

Why Join This Team?

Work on mission-critical systems used by financial professionals worldwide
Solve real-world data challenges at scale
Collaborate with a diverse team of engineers and domain experts
Enjoy a flexible hybrid working model with autonomy and support
Accelerate your career with learning opportunities and mentorship

Diversity & Inclusion

The client is committed to fostering an inclusive and accessible workplace. They welcome applicants from all backgrounds and provide accommodations throughout the hiring process to ensure fairness and equity.

Interested?

If you're excited about building data systems that matter, enjoy writing clean code, and want to grow in a collaborative environment - this could be the perfect next step in your career