Data Engineer

We are partnering with a leading organisation to recruit an experienced Senior Data Engineer to play a key role in the design, development, and optimisation of modern data platforms. This position sits at the heart of the data function, supporting analytics, reporting, and AI-driven initiatives through reliable, secure, and scalable data infrastructure.

You will collaborate closely with data engineers, BI developers, analysts, process engineers, and senior stakeholders to ensure data solutions align with business goals and best practice., * Design, build, and maintain scalable, cloud-based data pipelines using Microsoft technologies such as Azure Data Factory, Azure Synapse, Databricks, and Microsoft Fabric

• Define and promote best practices around data architecture, governance, security, and quality
• Develop and optimise ETL/ELT processes to support reporting, analytics, and AI use cases
• Partner with data scientists and process engineers to productionise machine learning models and large language models
• Ensure data platforms are performant, cost-effective, and scalable across data warehouse and lakehouse environments
• Evaluate and implement emerging data and AI technologies to enhance analytical capability
• Work closely with business stakeholders to understand data requirements and translate them into technical solutions
• Ensure compliance with internal data governance standards and relevant industry regulations
• Manage and collaborate with third-party vendors supporting data and platform initiatives

• Proven hands-on experience designing and optimising data pipelines for both structured and unstructured data
• Strong experience supporting CI/CD and DevOps practices for data pipelines and analytics platforms
• Demonstrated ability to troubleshoot, optimise, and scale data solutions
• Exposure to business intelligence and data visualisation tools
• Experience working across multidisciplinary teams, including analysts, data scientists, and engineers
• Solid understanding of business processes and how data supports decision-making
• Strong stakeholder management skills, with the ability to influence, advise, and drive collaboration
• Excellent communication skills, able to translate complex technical concepts into clear business language
• Experience leading or contributing to change initiatives and driving adoption of new technologies, * Strong expertise in data modelling, database design, and data pipeline development
• Experience with both SQL and NoSQL technologies
• Hands-on experience with at least one major cloud platform (Azure, AWS, or GCP)
• Experience with big data technologies such as Spark, Hadoop, or Kafka
• Proficiency with ETL/ELT tools and frameworks (e.g. Airflow, dbt, Informatica)
• Strong programming skills in Python, Java, Scala, or similar
• Experience implementing data governance, security, and compliance frameworks