Principal Data Platform Architect

We are seeking a Principal Data Platform Architect with proven experience leading enterprise data platform migrations from Palantir Foundry to Databricks.

This role will drive the strategic design, migration, and optimization of the enterprise data ecosystem, transitioning data pipelines, ontologies, and transformation workflows from Palantir Foundry to a scalable Databricks Lakehouse architecture.

The successful candidate will provide architectural leadership and technical direction, ensuring data integrity, governance, performance, and long-term platform sustainability. You will collaborate closely with data engineering, DevOps, and business stakeholders to modernize the data platform, establish best practices, and deliver a secure and high-performance migration.

Responsibilities

• Define and execute the end-to-end migration roadmap from Palantir Foundry to Databricks, including target architecture, data models, security, and governance frameworks.
• Analyze existing Foundry pipelines, datasets, and ontologies, and redesign them into scalable Databricks (Delta Lake) ETL/ELT workflows using PySpark and SQL.
• Implement validation frameworks to ensure complete data accuracy, consistency, and lineage throughout the migration process.
• Optimize Spark workloads, cluster configurations, and storage strategies to ensure high performance and cost-efficient operations in Databricks.
• Collaborate with data engineers, platform teams, and business stakeholders to minimize migration risk, ensure smooth cutover, and maintain production stability., A global technology company is seeking a Principal DevOps Engineer to enhance its software delivery processes. In this pivotal role, you will design and improve systems that streamline software delivery, focusing on automation and reliability across hybrid infrastructure...., A consultancy firm in Greater London is looking for an ambitious Solutions Architect to join their Digital business unit. This role involves leading the design and delivery of secure, cloud-native platforms across various domains, including Energy and Finance. As a..., Role: AWS Migration Architect (DC Exit) Find out more about the daily tasks, overall responsibilities, and required experience for this opportunity by scrolling down now.Location: London (Hrbrid role) Role SummaryLead a high-profile Data Centre (DC) Exit and..., Our Principal Technical Architects are responsible for leading and delivering strategically significant, complex client engagements across our portfolio of clients. We believe that great delivery stems from a thorough understanding of our clients and their needs, strong..., Title: Principal AI Architect Location: Remote UK, London Preferred Reports To: Global Head of AI & Advisory About Atlas Technica Atlas Technica is the premier Managed Service Provider (MSP) for the alternative investment industry. We power the technology behind the...

• Advanced Databricks Experience. Deep knowledge of Databricks architecture, Delta Lake, job orchestration, cluster management, and performance tuning.
• Proven Migration Experience (Palantir * Databricks). Demonstrated experience leading or executing platform migrations, including pipeline conversion, data model redesign, and production cutover.
• Expert-Level PySpark & Python Skills. Strong ability to design, optimize, and refactor distributed data processing workflows.
• Advanced SQL & Data Modelling Expertise. Experience in dimensional modeling, lakehouse architecture patterns, and query optimization.
• Cloud Platform Experience (Azure preferred). Hands-on experience deploying and managing data platforms in cloud environments, including storage, security, and networking considerations.

Nice to have

• Hands-on Expertise in Palantir Foundry. Proven experience with Foundry pipelines, ontologies, data lineage, transformations, and platform governance.
• Understanding of the Investment Data Domain.
• Familiarity with Dynatrace or Datadog for system observability and monitoring.
• Databricks certification, cloud certifications (Azure/AWS), or enterprise data architecture certifications.

A leading technology consultancy is seeking an experienced Principal Platform Architect to lead cloud transformations in the public sector. This fully remote role requires expertise in AWS, Azure, and GCP, along with SC or DV security clearance. Responsibilities include..., Job Description Customer Experience & Contact Platform Architect - Manager London / Manchester / Edinburgh CL7 Accenture is a leading global professional services company, providing a broad range of services in customer, strategy and consulting, technology and..., Company Overview Docusign brings agreements to life. Over 1.5 million customers and more than a billion people in over 180 countries use Docusign solutions to accelerate the process of doing business and simplify people's lives. With intelligent agreement management,...