> Markdown version of [/jobs/ext/4006101-azure-databricks-architect](https://www.wearedevelopers.com/jobs/ext/4006101-azure-databricks-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Azure Databricks Architect

- **Company:** ConglomerateIT LLC
- **Location:** Dallas, TX, United States
- **Experience:** Expert
- **Contract:** Temporary to permanent
- **Skills:** Artificial Intelligence, Amazon Web Services, Data Analysis, Application Integration Architecture, Microsoft Azure, Big Data, Cloud Computing, Information Engineering, Data Governance, Software Design Documents, High-Level Architecture, Information Extraction, Performance Tuning, Role-Based Access Control, Search Technologies, Enterprise Data Management, Real Time Systems, Chatbots, Data Ingestion, Retrieval-Augmented Generation, Large Language Models, Palantir Foundry, Apache Spark, Change Data Capture, Data Lakes, Information Technology, Drilldown, Machine Learning Operations, Data Pipelines, Databricks
- **Published:** October 29, 2026
- **Apply:** https://www.careerjet.com/jobad/usc68230c0c92f6b814a5dc980ae684fb1

## About the Role

Deep experience in Databricks solution architecture, Lakehouse design, Delta Lake, Apache Spark, and enterprise data engineering.
Strong command of Bronze/Silver/Gold architecture, data ingestion, transformation, data quality, change data capture (CDC), and batch and near-real-time processing.
Demonstrated experience with Palantir Foundry and/or Palantir AIP, ideally on platform migrations, capability mapping, and application or workflow redesign.
Solid knowledge of AI/GenAI solutions, including LLMs, RAG, document intelligence, information extraction, embeddings, vector search, and model serving.
Hands-on experience with Unity Catalog, enterprise data governance, security, access controls, and cloud platforms such as AWS, Azure, or GCP.
Experience architecting analytics, dashboards, chatbots, application integrations, and business workflows in enterprise environments.
Proven technical leadership, architecture documentation, performance optimization, and stakeholder management, with the ability to lead complex migration programs.
Bachelor's degree in Computer Science, Engineering, or a related field.

## Description

We are looking for a Senior Databricks Solution Architect to drive the architecture and technical delivery of a migration from Palantir Foundry to Databricks. You will review the current Palantir applications, map their capabilities to Databricks services, design the target-state Lakehouse, and guide the move of data engineering, AI/GenAI, analytics, chatbot, and business workflow solutions onto a scalable, secure, high-performance platform. Key Responsibilities
Design the target-state Databricks architecture, including a scalable Lakehouse across Bronze, Silver, and Gold layers.
Evaluate existing Palantir Foundry pipelines, datasets, applications, workflows, and AI capabilities; build feature-by-feature mappings to Databricks and flag components that need redesign.
Lead the migration of data ingestion, transformation, data quality, validation, large-scale data comparison, and reconciliation capabilities.
Build and tune data pipelines using Databricks Lakeflow, Spark Declarative Pipelines, Apache Spark, and Delta Lake for both batch and near-real-time processing.
Architect AI/GenAI solutions covering structured and unstructured document extraction, large language models (LLMs), retrieval-augmented generation (RAG), embeddings, vector search, model serving, and the migration of Palantir AIP capabilities.
Design target-state solutions for dashboards, drill-down reporting, analytical applications, chatbots, conversational analytics, and business workflows.
Put enterprise data governance, security, access controls, lineage, and auditing in place using Unity Catalog and suitable role-based access control (RBAC) policies.
Tune Databricks workloads, data pipelines, and compute resources for scalability, performance, reliability, and cost efficiency.
Lead data engineering and AI/ML teams, run architecture reviews, produce high-level design (HLD) and low-level design (LLD) documents and migration roadmaps, and work with business stakeholders, Palantir subject matter experts (SMEs), cloud architects, and application teams. Requirements