> Markdown version of [/jobs/ext/328833-data-engineer](https://www.wearedevelopers.com/jobs/ext/328833-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** AD Data Analytics - **Location:** Peterborough, UK - **Experience:** Expert - **Salary:** £50,000.0 - £55,000.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Computer Programming, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Mining, Relational Databases, Python (Programming Language), SQL Databases, Data Logging, Data Processing, Azure Data Factory, System Availability, Apache Spark, Git, Data Analytics, Apache Kafka, Spark Streaming, Data Management, Stream Processing, Software Version Control, Data Pipelines, Databricks - **Published:** June 6, 2026 - **Apply:** https://uk.indeed.com/viewjob?jk=630b8894b3c737c5 ## About the Role Do you have experience in Spark?, * Proficiency in programming languages such as Java, Python, and SQL. * 5+ years of experience in data engineering or related roles. * Proven expertise in Azure Data Factory and Azure Databricks. * Strong proficiency in Python for data engineering tasks. * Solid understanding of SQL and relational databases. * Exposure to real-time data processing frameworks (e.g., Spark Streaming, Kafka). * Experience in maintaining and supporting production-grade data pipelines. * Experience with version control systems (e.g., Git) and CI/CD pipelines. * Excellent problem-solving skills and attention to detail. * Strong communication and collaboration abilities * Excellent problem-solving skills coupled with strong communication abilities. If you are passionate about leveraging technology to drive business insights through effective data management, we encourage you to apply for this exciting opportunity as a Data Engineer. ## Description We are seeking a skilled and motivated Data Engineer to join our dynamic team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines and architectures that support our data-driven decision-making processes. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure is efficient, scalable, and aligned with business needs., * Design and implement robust data pipelines using Azure Data Factory (ADF) and Databricks. * Develop scalable ETL/ELT processes to ingest, transform, and load data from various sources. * Write clean, efficient, and reusable Python code for data processing and automation. * Optimize and manage SQL queries for data extraction, transformation, and reporting. * Collaborate with business stakeholders to understand data requirements and deliver solutions aligned with business goals. * Ensure data quality, integrity, and security across all data platforms. * Monitor and troubleshoot data pipelines to ensure high availability and performance. * Implement logging, alerting, and error-handling mechanisms for proactive issue resolution * Apply domain knowledge of trading and financial markets to enhance data models and analytics capabilities. ## Related Videos - [Data Science on Software Data](https://www.wearedevelopers.com/videos/162-data-science-on-software-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers)