> Markdown version of [/jobs/ext/1606351-data-engineer-databricks](https://www.wearedevelopers.com/jobs/ext/1606351-data-engineer-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer (Databricks) - **Company:** Korn Ferry - **Location:** London, UK - **Experience:** Expert - **Salary:** £130,000.0 - **Contract:** Contract - **Skills:** Agile Methodology, Microsoft Azure, Big Data, Cloud Engineering, Software Quality, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Security, Distributed Computing Environment, Korn Shell, Performance Tuning, Scrum Methodology, Cloud Platform System, Azure Data Factory, Data Programming, Data Pipelines, Databricks - **Published:** July 23, 2026 - **Apply:** https://computerjobs.com/gb/en/mob/job/5E3D82DB9AC585A150 ## About the Role Requirements (Must Have Skills) * 6+years of experience in data software engineering with a strong focus on Azure technologies * Expertise in Azure Databricks development, including efficient handling of large datasets * Strong working knowledge of Azure Data Factory for building complex ETL workflows * Experience with performance optimization of data pipelines and distributed processing setups * Proficiency in Scala development (hands-on experience highly desirable) * Solid understanding of Azure services relevant to data engineering and cloud architecture * Strong problem-solving ability with effective communication skills for team collaboration Nice to Have Skills * Experience working in Agile teams, including Scrum or Kanban methodologies * Familiarity with CI/CD practices and tools for data engineering workflows * Databricks certification or equivalent credentials * Understanding of data security, compliance, and governance best practices in cloud environments ## Description Data Software Engineer - Azure Databricks Location: London, UK Rate: £500 per day, inside IR35 Working Mode: 3 days a week on site Description We're looking for a Data Software Engineer - Azure Databricks to join our client (Financial Services) team in London, UK in an hybrid working mode. In this role, you will design and build data engineering solutions leveraging Azure Databricks and related Azure services, enabling efficient processing and transformation of large-scale datasets. You will collaborate with cross-functional teams to ensure the delivery of optimized, reliable, and scalable data pipelines aligned with business requirements. Responsibilities * Develop robust, scalable data engineering solutions using Azure Databricks and Azure Data Factory * Design and optimize data pipelines for processing large volumes of data (multi-million records) with high performance * Participate in customer discussions, requirement analysis, and technical solution design * Ensure code quality, performance tuning, and adherence to best practices throughout development * Communicate project status effectively and escalate critical issues to stakeholders and management * Actively collaborate with team members to deliver data-driven solutions in an Agile environment Requirements (Must Have Skills) * 6+years of experience in data software engineering with a strong focus on Azure technologies * Expertise in Azure Databricks development, including efficient handling of large datasets * Strong working knowledge of Azure Data Factory for building complex ETL workflows * Experience with performance optimization of data pipelines and distributed processing setups * Proficiency in Scala development (hands-on experience highly desirable) * Solid understanding of Azure services relevant to data engineering and cloud architecture * Strong problem-solving ability with effective communication skills for team collaboration Nice to Have Skills * Experience working in Agile teams, including Scrum or Kanban methodologies * Familiarity with CI/CD practices and tools for data engineering workflows * Databricks certification or equivalent credentials * Understanding of data security, compliance, and governance best practices in cloud environments About Korn Ferry Korn Ferry unleashes potential in people, teams, and organizations. We work with our clients to design optimal organization structures, roles, and responsibilities. We help them hire the right people and advise them on how to reward and motivate their workforce while developing professionals as they navigate and advance their careers. To learn more, please visit our website ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)