> Markdown version of [/jobs/ext/2324688-data-engineer-azure-databricks](https://www.wearedevelopers.com/jobs/ext/2324688-data-engineer-azure-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer (Azure Databricks) - **Company:** Infoplus Technologies UK Ltd - **Location:** London, UK - **Experience:** Expert - **Contract:** Contract - **Skills:** Agile Methodology, Airflow, Data Analysis, Apache HTTP Server, Automation of Tests, CA Workload Automation Ae, Microsoft Azure, Big Data, Cloud Computing, Computer Programming, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Systems, Data Warehousing, Linux, DevOps, Github, Python (Programming Language), PostgreSQL, SQL Azure, Modular Design, Windows PowerShell, Scrum Methodology, Standard Sql, Azure Data Lake, Service-Oriented Architecture, Software Engineering, SQL Server Integration Services, Data Streaming, Talend, YAML, Scripting, Test-Driven Development (TDD), Azure Data Factory, Delivery Pipeline, Apache Spark, Gitlab, Git, Data Lakes, Gitlab-ci, Data Analytics, Extreme Programming, Apache Kafka, Puppet, Terraform, Data Pipelines, Docker, Databricks, Programming Languages, Control M - **Published:** August 1, 2026 - **Apply:** https://computerjobs.com/gb/en/mob/job/DCB548E7E02E0DCA6E ## About the Role * 8-10 years of hands-on experience in data engineering space, with ability to translate working solution into implementable working package and/or built new solution using Azure platform * high proficiency and experience in designing/developing data analytics and data warehouse solutions with Azure Data Factory (ADF) and Azure Databricks, services related to Azure Analytics, Azure data lake storage Gen2, Azure SQL/Postgres, Azure analytics services and good understanding of Azure identity (SPN, SAMI, UAMI etc.) * experience in designing large data distribution, integration with service-oriented architecture, data mesh, data Lake and data analytics solution using Azure data services with large and multi-format data * proficient coding experience using Spark (Python/Scala) and SQL * hands on experience with one of Scripting language: Linux/PowerShell. * prior ETL development experience using industry tool eg informatica/SSIS/Talend etc., good to have knowledge in Kafka streaming Azure Infrastructure * a proven track of work experience in cloud (MS Azure platform preferred) in an agile SDLC environment, leveraging modern programming languages, DevOps, and test-driven development * Exposure to Docker, Git * hands on experience with pipeline orchestration tools like Apache Airflow, Autosys, Control-M - Preferred Apache Ariflow * proficient at working with large and complex code bases using GitLab/Github, Fork/Pull Model and CI/CD * knowledge of DevOps tools and technologies (like GitLab CI/CD pipeline creation, YAML, Terraform, ARM, Puppet), Azure function app, logic app is a plus * working experience in Agile methodologies (SCRUM, XP, Kanban). Work within an agile SDLC environment to deliver high-quality data solutions * you should hold a relevant bachelor's degree or equivalent. Excellent communication skills, with fluency in English for both presentations and technical writing Profile we are looking for A pragmatic, hands-on Azure Databricks Data Engineer who is comfortable working in an HR context, values automated testing and quality, and can independently deliver well-engineered HR solutions while collaborating closely with cross-functional teams. ## Description Role summary We are looking for an experienced Azure Databricks Data Engineer. The role focuses on designing, configuring, and developing HR solutions across the employee life cycle, with strong emphasis on quality, automation, and scalable design. Key responsibilities Design, develop, and improve the digital products and technology services we provide to our clients and employees. apply a broad range of software engineering practices, from analysing user needs and developing new features to automated testing and deployment. ensure the quality, security, reliability, and compliance of our solutions by applying our digital principles and implementing both functional and non-functional requirements. build observability into our solutions to monitor production health, help to resolve incidents, and remediate the root cause of risks and issues. continuously up-skill, learn new technologies and practices, reuse strategic platforms and standards, evaluate options, and make decisions with long-term sustainability in mind. Required skills and experience * 8-10 years of hands-on experience in data engineering space, with ability to translate working solution into implementable working package and/or built new solution using Azure platform * high proficiency and experience in designing/developing data analytics and data warehouse solutions with Azure Data Factory (ADF) and Azure Databricks, services related to Azure Analytics, Azure data lake storage Gen2, Azure SQL/Postgres, Azure analytics services and good understanding of Azure identity (SPN, SAMI, UAMI etc.) * experience in designing large data distribution, integration with service-oriented architecture, data mesh, data Lake and data analytics solution using Azure data services with large and multi-format data * proficient coding experience using Spark (Python/Scala) and SQL * hands on experience with one of Scripting language: Linux/PowerShell. * prior ETL development experience using industry tool eg informatica/SSIS/Talend etc., good to have knowledge in Kafka streaming Azure Infrastructure * a proven track of work experience in cloud (MS Azure platform preferred) in an agile SDLC environment, leveraging modern programming languages, DevOps, and test-driven development * Exposure to Docker, Git * hands on experience with pipeline orchestration tools like Apache Airflow, Autosys, Control-M - Preferred Apache Ariflow * proficient at working with large and complex code bases using GitLab/Github, Fork/Pull Model and CI/CD * knowledge of DevOps tools and technologies (like GitLab CI/CD pipeline creation, YAML, Terraform, ARM, Puppet), Azure function app, logic app is a plus * working experience in Agile methodologies (SCRUM, XP, Kanban). Work within an agile SDLC environment to deliver high-quality data solutions * you should hold a relevant bachelor's degree or equivalent. Excellent communication skills, with fluency in English for both presentations and technical writing Profile we are looking for A pragmatic, hands-on Azure Databricks Data Engineer who is comfortable working in an HR context, values automated testing and quality, and can independently deliver well-engineered HR solutions while collaborating closely with cross-functional teams. ## Related Videos - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [CI/CD with Github Actions](https://www.wearedevelopers.com/videos/856-ci-cd-with-github-actions) - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers)