> Markdown version of [/jobs/ext/1200262-databricks-architect](https://www.wearedevelopers.com/jobs/ext/1200262-databricks-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Databricks Architect - **Company:** Tredence Inc. - **Location:** Leeds, UK - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Query Performance, Artificial Intelligence, Amazon Web Services, Microsoft Azure, Big Data, Cloud Engineering, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, Extract Transform Load (ETL), Data Systems, Data Warehousing, DevOps, Disaster Recovery, Distributed Systems, Machine Learning, Meta-Data Management, Performance Tuning, Role-Based Access Control, Cloud Services, Azure Machine Learning, SQL Databases, Systems Integration, Data Ingestion, Apache Spark, Data Strategy, Data Lakes, Pyspark, Apache Kafka, Data Management, Machine Learning Operations, Terraform, Stream Processing, Data Pipelines, Databricks - **Published:** July 8, 2026 - **Apply:** https://find.jobs/jobs-near-me/apply/ats-redirect/?id=2862758187-2 ## About the Role * 10-15 years overall experience in data engineering or data architecture. * 5+ years of hands-on architecture experience specifically in Databricks. * Expert in Apache Spark, PySpark, Databricks SQL, Delta Lake, and distributed systems. * Strong understanding of Lakehouse architecture, BI ecosystems, and modern data platforms. * Cloud expertise in Azure / AWS / GCP (Azure preferred for many UK clients). * Experience with CI/CD, Infrastructure-as-Code (Terraform preferred), and DevOps. * Proven experience leading teams and delivering enterprise-grade data solutions., * Databricks certifications (e.g., Databricks Certified Data Engineer Professional, Architect). * Experience building ML solutions using MLflow or integrating with cloud ML services. * Experience in BFSI, Retail, Telecom, or Healthcare data environments. * Experience with real-time data processing (Kafka, EventHub, Kinesis). Soft Skills * Excellent communication and stakeholder management skills. * Strong problem-solving and solution-oriented mindset. * Ability to lead in a fast-paced and dynamic environment. * Collaborative, proactive, and able to provide strong technical direction. ## Description We are seeking a highly experienced Databricks Architect to lead the design, development, and optimization of scalable data platforms and advanced analytics solutions. This role requires a deep understanding of Databricks Lakehouse architecture, big data engineering, cloud ecosystems, and enterprise data strategy. The ideal candidate will partner with business and technology leaders to deliver high-performance data systems that support analytics, AI/ML, and real-time insights., Architecture & Solution Design * Architect end-to-end Databricks Lakehouse solutions including data ingestion, ETL/ELT pipelines, Delta Lake, data warehousing, and data governance frameworks. * Define and enforce best practices, security standards, and performance optimization across Databricks workloads. * Design scalable big data architectures leveraging Spark, Delta Live Tables, Unity Catalog, and MLflow. * Lead cloud architecture design on Azure/AWS/GCP (based on organization need) integrated with Databricks. Data Engineering & Platform Build * Build and optimize large-scale ETL/ELT pipelines using PySpark, SQL, and Delta. * Oversee data quality frameworks, metadata management, lineage, and monitoring. Leadership & Stakeholder Engagement * Work closely with business leaders and product teams to translate requirements into robust technical solutions. * Guide development teams, perform architecture reviews, and ensure platform engineering excellence. * Conduct technical workshops, POCs, and roadmap planning for the Databricks environment. Performance, Security & Governance * Optimize Databricks clusters, query performance, and cost management. * Implement data governance standards using Unity Catalog, RBAC, and compliance guidelines (GDPR, ISO). * Ensure resilience, scalability, and disaster recovery readiness. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)