> Markdown version of [/jobs/ext/2353483-data-engineer](https://www.wearedevelopers.com/jobs/ext/2353483-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Square One Resources Limited - **Location:** Sheffield, UK - **Experience:** Expert - **Salary:** £78,000.0 - £110,500.0 - **Contract:** Temporary contract - **Skills:** Data Analysis, Apache HTTP Server, Computing Platforms, Microsoft Azure, Bash Shell, Cloud Computing, Cloud Database, Databases, Continuous Integration, Information Engineering, Data Integration, Extract Transform Load (ETL), Data Warehousing, Elasticsearch, Github, Identity and Access Management, Python (Programming Language), Linux System Administration, Log Analysis, Nginx, Windows PowerShell, Ansible, Prometheus, Kusto Query Language, Standard Sql, Azure Data Lake, Data Streaming, Scripting, Cloud Platform System, Azure Data Factory, Delivery Pipeline, Grafana, Azure Powershell, Kubernetes, Deployment Automation, Real Time Data, Apache Kafka, Cosmos DB, Spark Streaming, Terraform, Stream Analytics, Software Version Control, Data Pipelines, Serverless Computing, Databricks - **Published:** August 19, 2026 - **Apply:** https://www.careerboard.com/pt/en/find-jobs-in-United-Kingdom/-F1E4865D951B9B03D4/ ## About the Role * Strong experience with Azure and Azure DevOps * Strong Python and SQL skills, including KQL * Experience with Bash, PowerShell and Azure CLI * Strong Linux administration and Scripting * Experience with GitHub, source control and CI/CD pipelines * Understanding of networking, operating systems, storage and infrastructure Data Engineering * Experience designing and maintaining large-scale data pipelines and ETL workflows * Strong experience in data acquisition, transport, cleaning and integration * Experience with data modelling, data warehousing and data cataloguing * Experience with pipeline automation, productionisation and optimisation * Experience supporting Real Time analytics and streaming data platforms Azure Data Platform * Azure Data Factory * Azure Databricks and Unity Catalog * Azure Data Lake and Synapse Analytics * Azure Functions and Azure Logic Apps * Azure Monitor and Azure Log Analytics * Power BI Cloud & Infrastructure * Strong knowledge of Azure IAM, networking, compute, storage, databases, and containers * Experience with Kubernetes and cloud-native platforms * Experience with Infrastructure as Code, including Terraform, ARM, Chef or Ansible * Experience with cloud cost optimisation * Understanding of SRE principles Streaming & Platform Technologies * Experience with Azure Event Hubs, Kafka and Spark Streaming * Knowledge of Nginx, Apache, Cosmos DB, Prometheus, Grafana and Elasticsearch ## Description * Design, build and maintain large-scale data pipelines and ETL workflows across enterprise datasets * Ingest, provision, and manage raw, enriched, and curated data assets for analytics platforms * Improve reliability, scalability and Real Time data ingestion capabilities * Support and enhance cloud-based data ingestion infrastructure and platform services * Acquire, transport, clean, transform and integrate data from internal and external sources * Perform exploratory data analysis and onboard new data sources * Develop automated data engineering workflows and optimise data processing pipelines * Manage data modelling, data warehousing, data integration and data cataloguing activities * Support Real Time analytics and streaming data platforms * Contribute to cloud infrastructure engineering, platform operations and production support * Implement cloud cost optimisation and platform efficiency improvements * Collaborate with engineering, analytics, infrastructure and cybersecurity teams * Support DevOps automation, monitoring and operational excellence initiatives * Maintain documentation, governance standards and operational procedures ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [5 steps for running a Kubernetes environment at scale](https://www.wearedevelopers.com/videos/88-5-steps-for-running-a-kubernetes-environment-at-scale) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Post-Quantum Cryptography: Preparing for Q-Day](https://www.wearedevelopers.com/videos/100179-post-quantum-cryptography-preparing-for-q-day) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [All your telemetry data from any source in one place](https://www.wearedevelopers.com/videos/57-all-your-telemetry-data-from-any-source-in-one-place) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk)