> Markdown version of [/jobs/ext/2925749-databricks-architect](https://www.wearedevelopers.com/jobs/ext/2925749-databricks-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Databricks Architect - **Company:** Kforce Inc. - **Location:** Harrison, NY, United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Query Performance, Artificial Intelligence, Data Analysis, Microsoft Azure, Cluster Analysis, Data Architecture, Information Engineering, Data Governance, Data Integrity, Extract Transform Load (ETL), Data Security, Data Systems, Apache Hadoop, Apache Hive, Cloud Services, Data Streaming, Cloud Platform System, Data Lakes, Information Technology, Serverless Computing, Databricks - **Published:** September 15, 2026 - **Apply:** https://www.dice.com/job-detail/5b336e25-74d7-48f7-83b1-fb152b9742a9 ## About the Role * Bachelor's or Master's degree in Computer Science, Engineering, or related field * 10+ years of experience in data architecture, with significant hands-on experience in Hadoop and Databricks environments * Proven expertise in cloud data platforms (Azure), data engineering, and ETL processes * Strong understanding of Lakehouse architecture, data federation, and modern data governance frameworks (e.g., Unity Catalog) * Experience leading large-scale migration projects, including MVP definition and iterative delivery * Advanced proficiency with Databricks features such as Delta Lake, Liquid Clustering, AI monitoring, and serverless compute * Excellent communication, leadership, and stakeholder management skills * Ability to mentor and guide cross-functional teams in adopting best practices and innovative data solutions Preferred Skills: * Experience with Databricks Migration Accelerator or similar migration tools * Hands-on expertise in testing advanced features (dynamic clustering, Lakehouse Federation, Unity Catalog) * Knowledge of data security, access controls, and compliance in cloud environments * Experience generating synthetic data and ensuring data governance in migration scenarios ## Description Kforce has a client in Purchase, NY that is seeking a Databricks Architect., We are seeking a highly skilled and strategic Lead Databricks Architect to spearhead our migration from Hadoop to Databricks, establishing scalable, repeatable Lakehouse solutions. You will lead the design, implementation, and optimization of cloud-based data platforms, enabling advanced analytics, AI capabilities, and modern data governance., * Lead the identification and categorization of existing Hadoop workloads (ETL, batch, streaming) and data sources for migration to Databricks * Design and implement scalable, repeatable migration use cases, focusing on MVP (Minimum Viable Product) approaches to accelerate value delivery * Provision and architect Databricks environments, including sandbox workspaces with Lakehouse architecture and federation capabilities * Enable seamless connectivity to external data sources (e.g., Hive) and oversee pilot migrations using tools such as Databricks Migration Accelerator or third-party partner solutions * Validate migrated workloads for performance, cost efficiency, and data integrity, leveraging features like Z-ordering, Liquid Clustering, Lakehouse AI monitoring, and Serverless warehouse capabilities * Monitor query performance, storage efficiency, and pipeline health using advanced Databricks features and best practices * Collaborate cross-functionally with data engineering, analytics, and governance teams to validate outcomes and incorporate feedback * Document learnings, blockers, and feature gaps to inform broader rollout and continuous improvement efforts * Define and track success metrics such as migration time, query latency, cost savings, and feature adoption * Develop a phased roadmap for full-scale migration, advanced feature adoption, and future platform optimizations ## Related Videos - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) - [Enabling intelligent logistics automation: home-grown Industrial IoT platform at Austrian Post](https://www.wearedevelopers.com/videos/2018-enabling-intelligent-logistics-automation-home-grown-industrial-iot-platform-at-austrian-post) - [The Data Mesh as the end of the Datalake as we know it](https://www.wearedevelopers.com/videos/156-the-data-mesh-as-the-end-of-the-datalake-as-we-know-it) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)