> Markdown version of [/jobs/ext/2812927-data-engineer](https://www.wearedevelopers.com/jobs/ext/2812927-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Halian . - **Location:** Norwich, UK - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Data Analysis, Automation of Tests, Microsoft Azure, Business Systems, Cloud Database, Databases, Continuous Integration, Information Engineering, Data Governance, Data Integration, Extract Transform Load (ETL), Data Transformation, Data Mining, Data Warehousing, Relational Databases, Database Queries, Python (Programming Language), Machine Learning, SQL Azure, Power BI, Cloud Services, SQL Databases, Tableau (Software), Workflow Management Systems, Data Processing, Azure Data Factory, Snowflake, Git, Microsoft Fabric, Data Lakes, Software Version Control, Data Pipelines, Databricks - **Published:** September 10, 2026 - **Apply:** https://www.collegerecruiter.com/job/2847397384-data-engineer ## About the Role * Commercial experience in Data Engineering, Analytics Engineering, BI Engineering, or a closely related role * Strong SQL skills and experience working with relational data * Good Python skills for data processing and automation * Commercial experience building or maintaining data pipelines * Experience integrating data from multiple sources * Practical experience identifying and resolving data quality and consistency issues * Understanding of data modelling and analytical data structures * Experience with ETL or ELT processes * Experience working with databases, data warehouses, or cloud data platforms * Strong problem-solving skills and a methodical approach to investigating data issues, * Experience with Microsoft Azure and Azure data services * Knowledge of Azure Data Factory or similar orchestration tools * Experience with Databricks, Snowflake, or Microsoft Fabric * Experience with Azure SQL * Knowledge of dbt or similar data transformation frameworks * Experience working with data lakes or cloud data warehouses * Experience integrating data through APIs * Knowledge of Power BI, Tableau, or similar visualisation tools * Understanding of data quality and governance frameworks * Experience with CI/CD or automated testing for data pipelines * Experience supporting machine learning or AI projects * Basic understanding of statistics, machine learning, or Data Science * Experience using Git or another version control system * Excellent communication skills and the ability to work with technical and non-technical stakeholders ## Description * Building, maintaining, and improving reliable data pipelines across multiple business systems * Extracting, transforming, and loading data into centralised analytical environments * Integrating data from multiple internal systems and external sources * Investigating and resolving data quality, consistency, and integrity issues * Identifying discrepancies between systems and establishing reliable sources of truth * Developing reusable data transformation and processing workflows * Writing efficient SQL queries for data extraction, transformation, and analysis * Using Python to automate data processing and engineering tasks * Supporting the development and maintenance of data warehouses and analytical data structures * Monitoring data pipelines and investigating failures or unexpected results * Working with stakeholders to understand data requirements and translate them into technical solutions * Documenting data sources, transformations, pipelines, and processes * Creating trusted datasets to support reporting, analytics, Data Science, and future AI initiatives * Contributing to improvements in data governance, quality, and accessibility across the organisation ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Beyond Dashboards: Fixing Text-to-SQL with Semantic RAG](https://www.wearedevelopers.com/videos/2036-beyond-dashboards-fixing-text-to-sql-with-semantic-rag) - [Hacking MSSQL on Cloud. All of them. How I became sysadmin on Azure, AWS, GCP and Alibaba.](https://www.wearedevelopers.com/videos/100339-hacking-mssql-on-cloud-all-of-them-how-i-became-sysadmin-on-azure-aws-gcp-and-alibaba) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents](https://www.wearedevelopers.com/videos/1547-data-analytics-with-microsoft-fabric-end-to-end-use-case-with-data-agents) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk)