Data Engineer
Design and maintain scalable data pipelines within an Azure and Databricks lakehouse environment, transforming raw data into curated datasets for analytics. Focus on building robust ELT processes using PySpark, implementing data quality and security controls, and optimising performance and cost. Work collaboratively in an Agile environment with strong DevOps practices, contributing to infrastructure as code and CI/CD pipelines using Terraform and Git.