> Markdown version of [/jobs/ext/3184664-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/3184664-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** STACK Infrastructure EMEA Limited
- **Location:** London, UK
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Adaptable Database Systems, Application Programming Interfaces (APIs), Artificial Intelligence, Business Analytics Applications, Business Software, Spreadsheets, Software as a Service, Databases, Continuous Integration, Data Governance, Data Infrastructure, Data Integration, Data Systems, Document-Oriented Databases, Identity and Access Management, Python (Programming Language), Operational Databases, Power BI, SQL Databases, Azure Data Factory, Git, Data Lakes, Pyspark, Databricks
- **Published:** September 28, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=8dfb48a45418c7ee

## About the Role

* Significant experience as a Data Engineer, including ownership of production data pipelines.
 * Strong hands-on experience with Databricks, Delta Lake, Python, SQL and PySpark.
 * Experience integrating data from APIs, business applications, databases and files.
 * Experience with Unity Catalog, access management, data governance and data quality controls.
 * Experience administering Databricks workspaces, compute resources and SQL Warehouses.
 * Experience with Azure data services, Power BI, Git and CI/CD practices.
 * Understanding of environment management, monitoring, troubleshooting and cost control.
 * Ability to work directly with non-technical stakeholders and explain data issues clearly.
 * Strong documentation, prioritisation and problem-solving skills.

Certifications (Preferred)

 * Databricks Certified Data Engineer Professional or Databricks Certified Platform Administrator (if available).

## Description

The successful candidate will work closely with stakeholders to improve reporting, resolve data issues and support better decision-making across the organisation., * Design, build and maintain data pipelines from APIs, databases, SaaS applications, files and spreadsheets into Databricks.

 * Develop scalable data models and Delta Lake architecture for reporting, analytics and future AI use cases.
 * Manage Databricks Workflows, Lakeflow or Delta Live Tables, SQL Warehouses and related processing jobs.
 * Administer Databricks workspaces, Unity Catalog, permissions, service principals.
 * Support development, test and production environments, including deployment, monitoring, incident resolution and recovery.
 * Monitor platform performance, usage and costs, and implement appropriate security and operational controls.
 * Implement data quality checks covering completeness, accuracy, timeliness, consistency, duplicates and reconciliation with source systems.
 * Ensure dashboards use governed, reliable and well-documented data.
 * Establish data ownership, common definitions, lineage, access policies and governance standards with business functions.
 * Build monitoring and reporting to identify pipeline failures and data quality issues.
 * Integrate governed Databricks data with Power BI and other approved analytical tools.
 * Work with Finance, Delivery, Operations, HR and PMO to translate requirements into sustainable data solutions.
 * Document data pipelines, controls, dependencies and operating procedures.
 * Coordinate external partners where specialist support is required.