Lead Data Architect
Role details
Job location
Tech stack
Job description
Principal Data Platform ArchitectProject descriptionWe are seeking a Principal Data Platform Architect with proven experience leading enterprise data platform migrations from Palantir Foundry to Databricks.This role will drive the strategic design, migration, and optimization of the enterprise data ecosystem, transitioning data pipelines, ontologies, and transformation workflows from Palantir Foundry to a scalable Databricks Lakehouse architecture.The successful candidate will provide architectural leadership and technical direction, ensuring data integrity, governance, performance, and long-term platform sustainability. You will collaborate closely with data engineering, DevOps, and business stakeholders to modernize the data platform, establish best practices, and deliver a secure and high-performance migration.ResponsibilitiesDefine and execute the end-to-end migration roadmap from Palantir Foundry to Databricks, including target architecture, data models, security, and governance, About The Role Were looking for a Lead Data Architect to join our digital transformation consultancy. This is a strategic role that leads data strategy for public sector clients. Lead Data Architects look at data holistically, supporting clients to define the vision for..., About The Role Were looking for a Lead Data Architect to join our digital transformation consultancy. Check you match the skill requirements for this role, as well as associated experience, then apply with your CV below. This is a strategic role that leads data strategy..., Scroll down to find the complete details of the job offer, including experience required and associated duties and tasks.Our client, a leading organisation in the defence and security sector, is currently seeking a Lead Data Architect to join their team in Malvern. This..., Lead Data Architect ?? Edinburgh / Hybrid ?? Permanent ?? Up to £95,000 + benefits ?? Financial ServicesWe're supporting a major UK financial services organisation as they continue significant investment in modernising their enterprise data capabilities.This is a senior..., Scroll down to find the complete details of the job offer, including experience required and associated duties and tasks. Our client, a leading organisation in the defence and security sector, is currently seeking a Lead Data Architect to join their team in Malvern. This..., About The Role Were looking for a Lead Data Architect to join our digital transformation consultancy. Check you match the skill requirements for this role, as well as associated experience, then apply with your CV below.This is a strategic role that leads data strategy for... © 2026, Jobsora.com
Requirements
frameworks.Analyze existing Foundry pipelines, datasets, and ontologies, and redesign them into scalable Databricks (Delta Lake) ETL/ELT workflows using PySpark and SQL.Implement validation frameworks to ensure complete data accuracy, consistency, and lineage throughout the migration process.Optimize Spark workloads, cluster configurations, and storage strategies to ensure high performance and cost-efficient operations in Databricks.Collaborate with data engineers, platform teams, and business stakeholders to minimize migration risk, ensure smooth cutover, and maintain production stability.SkillsMust haveAdvanced Databricks Experience. Deep knowledge of Databricks architecture, Delta Lake, job orchestration, cluster management, and performance tuning.Proven Migration Experience (Palantir * Databricks). Demonstrated experience leading or executing platform migrations, including pipeline conversion, data model redesign, and production cutover.Expert-Level PySpark & Python Skills. Strong ability to design, optimize, and refactor distributed data processing workflows.Advanced SQL & Data Modelling Expertise. Experience in dimensional modeling, lakehouse architecture patterns, and query optimization.Cloud Platform Experience (Azure preferred). Hands-on experience deploying and managing data platforms in cloud environments, including storage, security, and networking considerations.Nice to haveHands-on Expertise in Palantir Foundry. Proven experience with Foundry pipelines, ontologies, data lineage, transformations, and platform governance.Understanding of the Investment Data Domain.Familiarity with Dynatrace or Datadog for system observability and monitoring.Databricks certification, cloud certifications (Azure/AWS), or enterprise data architecture certifications. Similar jobs
Benefits & conditions
Job Description Brand new Permanent Opportunity for a Lead/Principal Data Architect with an Emerging National Security Consultancy in Cheltenham - Must hold Active Enhanced DV (West) Clearance to start - Up to £105k DoE - Cheltenham location - 80% on-site - Essential...
