> Markdown version of [/jobs/ext/2826232-databricks-architect](https://www.wearedevelopers.com/jobs/ext/2826232-databricks-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Databricks Architect - **Company:** Intuitive Technology Partners Inc - **Location:** United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Airflow, Amazon Web Services, Amazon S3, Microsoft Azure, Cloud Computing, Cloud Storage, Databases, Continuous Integration, Data Architecture, Data Discovery, Information Engineering, Data Governance, Data Infrastructure, Extract Transform Load (ETL), Data Security, Apache Hive, Identity and Access Management, Operational Databases, Performance Tuning, Query Optimization, Role-Based Access Control, Azure Data Lake, Software Deployment, SQL Databases, Workflow Management Systems, Enterprise Data Management, Google Cloud, Azure Data Factory, Apache Spark, Git, Data Lakes, Pyspark, Data Lineage, Deployment Automation, AWS Glue, Terraform, Data Pipelines, Databricks - **Published:** September 10, 2026 - **Apply:** https://www.dice.com/job-detail/a54ed54b-615b-4139-ad20-c07327fa2004 ## About the Role * 5+ years of experience in Data Engineering. * Strong hands-on experience with Databricks. * Strong experience implementing and working with Unity Catalog. * Advanced PySpark and Apache Spark skills. * Strong SQL development and query optimization experience. * Hands-on experience with Delta Lake / Delta Tables. * Experience building enterprise-grade ETL/ELT data pipelines. * Experience with data governance, security, access management, and data lineage. * Experience with at least one major cloud platform: Azure, AWS, or Google Cloud Platform. * Strong understanding of Lakehouse architecture and modern data platforms. * Experience with Databricks Workflows/Jobs and production deployments. * Experience with Git and CI/CD. * Good understanding of data modeling and performance optimization. Preferred Skills * Experience with Terraform or Databricks Asset Bundles. * Experience with Azure Data Lake Storage, Amazon S3, or Google Cloud Storage. * Experience with Azure Data Factory, AWS Glue, Airflow, or similar orchestration tools. * Experience implementing Unity Catalog migration from legacy Hive Metastore. * Experience with row-level and column-level security. * Experience with Dynamic Views and fine-grained data access. * Experience with Databricks SQL and SQL Warehouses. * Experience with Delta Live Tables / Lakeflow Declarative Pipelines. * Experience with CI/CD automation for Databricks. * Knowledge of data privacy and compliance requirements. ## Description We are seeking an experienced Databricks Architect with strong hands-on expertise in Unity Catalog, Apache Spark, PySpark, SQL, and Delta Lake. The ideal candidate will design, develop, and optimize scalable data engineering solutions on the Databricks Lakehouse platform while ensuring strong data governance, security, and access controls through Unity Catalog., * Design and develop scalable data pipelines using Databricks, Apache Spark, PySpark, and SQL. * Build and optimize ETL/ELT pipelines using Delta Lake and Delta Tables. * Implement and manage Unity Catalog across Databricks environments. * Configure and manage Catalogs, Schemas, Tables, Views, External Locations, and Storage Credentials. * Implement data access controls, RBAC, permissions, and governance policies using Unity Catalog. * Support data lineage, auditing, data discovery, and governance requirements. * Design and maintain secure data lakehouse architectures across cloud environments. * Develop Databricks Jobs, Workflows, notebooks, and production-grade data pipelines. * Optimize Spark jobs, SQL queries, Delta tables, and overall pipeline performance. * Implement data quality, validation, monitoring, and error-handling frameworks. * Work with cloud storage platforms such as Azure Data Lake Storage, Amazon S3, or Google Cloud Storage. * Integrate Databricks with enterprise data platforms, databases, APIs, and downstream applications. * Implement CI/CD processes for Databricks development and deployment. * Use Git, Terraform, or Databricks Asset Bundles for infrastructure and deployment automation. * Troubleshoot production data pipelines and resolve performance and data-quality issues. * Collaborate with Data Architects, Cloud Engineers, Data Scientists, Business Analysts, and application teams. ## Related Videos - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)