> Markdown version of [/jobs/ext/3730904-senior-databricks-solutions-architect](https://www.wearedevelopers.com/jobs/ext/3730904-senior-databricks-solutions-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Databricks Solutions Architect

- **Company:** Prodapt Corp
- **Location:** Irving, TX, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Big Data, Cloud Engineering, Code Review, Databases, Data Architecture, Information Engineering, Data Governance, Data Transformation, Information Extraction, Role-Based Access Control, Cloud Services, Data Processing, Chatbots, Data Ingestion, Retrieval-Augmented Generation, Large Language Models, Palantir Foundry, Apache Spark, Change Data Capture, Agentic-AI, Data Lakes, Information Technology, Data Lineage, Data Management, Machine Learning Operations, Model Inference, Stream Processing, Data Pipelines, Databricks
- **Published:** October 14, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=1fbf526e2c1b22d8

## About the Role

* Bachelor's or Master's degree in Computer Science, Engineering, Information Technology or related discipline.
 * 14+ years of experience in data engineering/data architecture.
 * 5+ years of experience working with modern cloud data platforms.
 * Strong hands-on Databricks experience.
 * Proven experience designing enterprise-scale data platforms.
 * Experience leading technical teams and architecture initiatives.
 * Strong communication and stakeholder-management skills.
 * Ability to translate business requirements into scalable technical architectures.

## Description

We are looking for a Senior Databricks Solution Architect to lead the architecture and technical execution of a Palantir Foundry to Databricks migration. The candidate will be responsible for assessing the existing Palantir application, defining the target Databricks architecture, mapping existing capabilities to Databricks services, and providing technical leadership throughout the migration.
The solution involves migration of capabilities including data ingestion and transformation, AI-based information extraction from structured and unstructured documents, large-scale data comparison, dashboards and drill-down reporting, chatbot capabilities, and business workflows/applications.
The ideal candidate should have strong expertise in Databricks, Lakehouse architecture, data engineering, AI/ML workloads, and cloud-native data platforms, along with the ability to understand and decompose existing Palantir Foundry capabilities into equivalent or improved Databricks-based solutions., * Define the appropriate architecture across Bronze, Silver and Gold layers.

 * Design data ingestion, transformation, processing and serving patterns.
 * Define standards for Delta Lake, Unity Catalog, compute, storage, workloads and environments.
 * Design solutions for batch and near-real-time data processing., * Analyze the existing Palantir Foundry application, including its pipelines, datasets, applications, workflows and AI capabilities.
 * Create a feature-by-feature mapping between existing Palantir capabilities and Databricks capabilities.
 * Identify capabilities that can be migrated directly versus those requiring redesign.
 * Define migration patterns for:
 + Data ingestion pipelines
 + Data transformation pipelines
 + Data quality and validation
 + Data comparison and reconciliation
 + AI/LLM-based information extraction
 + Dashboards and reporting
 + Chatbot capabilities
 + Business workflows and actions
 + Document processing
 * Develop migration roadmaps, architecture decisions and technical dependencies.
 * Identify opportunities to improve scalability, maintainability and performance during migration., * Design ingestion from databases, APIs, files, documents and other enterprise data sources.
 * Establish data quality, validation, lineage and observability mechanisms.
 * Design incremental processing and change-data-capture patterns where required.
 * Optimize Delta tables, Spark workloads and Databricks compute for performance and cost., * Architect solutions for extracting information from structured and unstructured documents.
 * Design RAG and LLM-based solutions where applicable.
 * Evaluate appropriate Databricks capabilities for:
 + Document processing
 + Information extraction
 + Embeddings and vector search
 + LLM inference
 + Model serving
 + AI agents / conversational applications
 * Define approaches for migrating existing Palantir AIP-based extraction capabilities into Databricks.
 * Ensure AI solutions are scalable, secure, explainable and production-ready., * Implement enterprise data governance using Unity Catalog.
 * Define catalog, schema, table, volume and access-control strategies.
 * Design RBAC and data-access policies.
 * Define data lineage, auditing and governance standards.
 * Ensure compliance with enterprise security and privacy requirements.

7. Technical Leadership

 * Lead a team of data engineers, ML/AI engineers and developers.
 * Conduct architecture reviews and technical design sessions.
 * Create HLD/LLD documents, architecture diagrams and migration plans.
 * Establish Databricks development standards and best practices.
 * Review code and implementation approaches.
 * Work closely with business stakeholders, Palantir SMEs, cloud architects and application teams.
 * Troubleshoot complex architectural and performance issues.