> Markdown version of [/jobs/ext/2041121-data-engineer-databricks-outside-ir35-450-525](https://www.wearedevelopers.com/jobs/ext/2041121-data-engineer-databricks-outside-ir35-450-525). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - Databricks - Outside IR35 - £450 - £525 - **Company:** Primus Connect - **Location:** London, UK (Remote available) - **Experience:** Experienced - **Salary:** £117,000.0 - £136,500.0 - **Contract:** Temporary contract - **Skills:** Agile Methodology, Airflow, Amazon Web Services, Microsoft Azure, Code Review, Data Validation, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Apache Hive, Python (Programming Language), Data Streaming, Apache Spark, Git, Data Lakes, Pyspark, Apache Kafka, Spark Streaming, Terraform, Data Pipelines, Databricks - **Published:** August 13, 2026 - **Apply:** https://www.careerboard.com/pt/en/find-jobs-in-United-Kingdom/-A4912201D81370717E/ ## About the Role They are expanding their engineering capability and are looking for a Mid-Level Data Engineer with strong commercial Databricks and Spark experience to join an active delivery team., * Commercial experience building data pipelines using Databricks * Strong PySpark and Spark SQL skills * Solid Python experience within data engineering * Practical experience with Delta Lake * Understanding of medallion architecture and modern data platform principles * Experience working with Azure, AWS or GCP * Good understanding of Git and collaborative development practices * Experience working within Agile delivery environments * Strong communication skills and the ability to work effectively in a remote team Desirable Experience * Databricks certification * Unity Catalog * Databricks Asset Bundles * Terraform/Infrastructure as Code * Databricks Workflows * Airflow * Spark Structured Streaming * Kafka or Azure Event Hubs ## Description This is a hands-on engineering position where you will take ownership of data pipeline development, work with modern Databricks technologies and collaborate closely with senior engineers and wider delivery teams., * Design, build and maintain ETL/ELT data pipelines using Databricks, PySpark and Spark SQL * Develop and optimise Delta Lake tables using Bronze, Silver and Gold medallion architecture * Ingest data from a variety of source systems into Databricks * Write clean, maintainable and well-tested Python/data engineering code * Implement data quality checks, validation and monitoring * Participate in code reviews and collaborative development * Contribute to CI/CD pipelines for data engineering workloads * Work with senior engineers to deliver scalable data platform solutions * Collaborate with technical, analytics and business stakeholders * Participate in Agile ceremonies and delivery activities ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk) - [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)