Test Engineer (Data & Automation)
Overview
We are seeking an experienced Test Engineer to support the delivery of high-quality data and application solutions. This role focuses on automation, data validation, and production analysis within a modern cloud-based environment. You will play a key role in ensuring system reliability, improving testing frameworks, and driving best practices across engineering teams.
This is a collaborative position requiring strong technical expertise, analytical thinking, and the ability to mentor others while working across complex data platforms.
Key Responsibilities
Design, develop, and maintain automated test frameworks to improve testing efficiency and coverage
Analyse and interpret test results, identifying risks, issues, and areas for improvement
Produce clear reports on testing activities, outcomes, and associated risks
Automate data validation and application testing processes across distributed systems
Investigate production issues using data analysis to identify root causes
Work with orchestration tools (e.g., Apache Airflow) to monitor workflows and troubleshoot failures
Validate data using tools such as Jupyter Notebooks and Amazon Athena
Analyse data across multiple formats to ensure integrity and correctness of new functionality
Support CI/CD practices using Git-based workflows and pipeline automation
Participate in infrastructure and deployment activities, including containerisation and Infrastructure as Code
Collaborate with cross-functional teams to translate business requirements into testable solutions
Mentor and guide team members on testing methodologies and best practicesKey Skills & Experience
Technical Skills
Proficiency in Python, SQL, and at least one additional programming language (e.g., Java)
Experience with scripting languages such as Bash
Strong understanding of automated testing frameworks and methodologies
Hands-on experience with Apache Airflow and log analysis
Familiarity with data processing tools such as Apache Spark
Experience working with cloud platforms and services, including:
Monitoring and logging tools
Storage and data services
Compute and container services
Experience with CI/CD pipelines and version control systems (e.g., GitLab)
Knowledge of Infrastructure as Code (e.g., Terraform)
Familiarity with Docker and containerised environmentsData & Analytics
Strong data analysis skills, including working with structured and semi-structured data
Experience validating and querying data using tools such as Athena and notebooks
Understanding of data modelling concepts, including dimensional models and slowly changing dimensions
Ability to generate realistic test data for various scenariosAdditional Knowledge
Understanding of distributed data platforms and big data environments (e.g., EMR)
Knowledge of encryption principles (client-side and server-side)
Awareness of production system monitoring and incident analysisSoft Skills
Strong analytical and problem-solving abilities
Excellent communication skills, with the ability to present findings clearly
Proactive approach to identifying and mitigating risks
Ability to mentor and support less experienced team members
Collaborative mindset with experience working in agile delivery environmentsWorking Arrangements
UK-based role with flexible location
Occasional travel required for team collaboration sessions and workshops
:quality(80))
:quality(80))
:quality(80))