> Markdown version of [/jobs/ext/3520732-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/3520732-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Red Engine - **Location:** London, UK (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Agile Methodology, Business Logic, Microsoft Azure, Databases, Extract Transform Load (ETL), Data Visualization, Data Warehousing, Distributed File Systems, Python (Programming Language), Microsoft SQL Server, Transact-SQL, Parquet, Microsoft Power Automate, Azure Data Factory, Delivery Pipeline, Data Build Tool (dbt), Pyspark, Data Analytics, Restful APIs, Data Pipelines, Databricks - **Published:** October 1, 2026 - **Apply:** https://www.apply4u.co.uk/jobs/senior-data-engineer/49639574 ## About the Role Strongunderstanding of the Databricks Platform including managing, developing anddeploying workflows, jobs and notebooks. Provenexperience in modelling data in a Data warehouse using an Inmon or Kimballapproaches. Databasedevelopment experience in SQL Server including the creation of stored proceduresin T-SQL or a similar enterprise database toolset. Experienceworking in an Agile software development framework. Excellentworking knowledge of Data Build Tool (DBT) with a demonstrated ability indeveloping data models, contracts, tests, validation, and transformations Experienceworking with modern data distributed file formats (i.e., Parquet, Delta,Iceberg, Hudi) Demonstratedexperience with building data ingestion pipelines from REST API data sources. Strongability to produce technical documentation that can be understood by bothtechnical and non-technical audiences Strong working understanding in CloudAdministration and/or Database Administration. Experience with IaC solutions ## Description include: Developing and maintaining data pipelines to orchestrate the ingestion of data from disparate source systems into a centralised data analytics platform. Designing and implementingdata engineering solutions using T-SQL, Python, PySpark and DBT in the Azurecloud environment. Working with Data Analystsin promoting business logic into DBT data models, to support business reportsand dashboards. Maintaining and leveragingCI/CD deployment pipelines to promote application code into higher tierenvironments. Maintaining and updatingthe technical documentation suite in Azure DevOps. To be successful in this role, you'll: D emonstrate solid experience developing of ETL/ELT ingestion pipelinesto handle data movement, transformation and visualisations from structured andunstructured sources. Have experiencewith the Azure Platform including: DataIngestion: Azure Data Factory (ADF), Databricks, Logic Apps and Function App DataStorage: ADLS, SQL Server and Unity Catalog (Medallion Architecture)