Senior Databricks Architect

Our client, a large-scale organisation undergoing significant investment in data and cloud technologies, is seeking an experienced Senior Databricks Architect to join its expanding Data & AI practice.

This is an exciting opportunity to play a key role in large-scale data transformation programmes, helping enterprise organisations modernise legacy platforms and build cloud-native data solutions. You’ll be responsible for designing and delivering scalable data architectures, enabling advanced analytics, real-time data processing and modern data product delivery.

Working within a highly skilled and collaborative environment, you’ll have the opportunity to influence technical strategy, work with cutting-edge technologies and support some of the most complex data initiatives in the market.

You Will Work With

• Designing and delivering enterprise-scale data platforms using Databricks and AWS
• Building batch and real-time data pipelines from legacy and modern source systems
• Implementing real-time and event-driven data processing solutions
• Developing data transformation frameworks using Spark, PySpark and SQL
• Designing Lakehouse architectures using Databricks and Medallion Architecture principles
• Creating scalable, reusable data products to support modern data operating models
• Integrating data from complex legacy and enterprise data sources
• Driving data governance, quality, security and operational best practices
• Collaborating with business stakeholders, engineering teams and data consumers
• Providing architectural leadership across complex transformation programmes

• Proven experience as a Data Architect, Databricks Architect, Lead Data Engineer or Solutions Architect
• Strong expertise in Databricks, Apache Spark, PySpark and SQL
• Experience designing and implementing modern data lake or lakehouse architectures
• Hands-on experience with Kafka
• Strong understanding of AWS data services, particularly Amazon S3
• Experience integrating data from complex enterprise and legacy data environments
• Strong understanding of data governance, security and data quality frameworks
• Experience delivering large-scale cloud and data transformation programmes
• Excellent communication and stakeholder management skills

• Salary up to £115,000
• Performance-related bonus
• Comprehensive benefits package
• Excellent career progression opportunities
• Access to training and professional certifications
• Exposure to enterprise-scale cloud and data transformation projects
• Opportunity to work with the latest Databricks, AWS and streaming technologies
• Collaborative, innovation-led working environment