> Markdown version of [/jobs/ext/1921270-aws-azure-databricks-architect](https://www.wearedevelopers.com/jobs/ext/1921270-aws-azure-databricks-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AWS/Azure Databricks Architect - **Company:** Smart IT Frame - **Location:** Raritan, NJ, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Microsoft Azure, Cloud Computing, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, Data Security, Data Systems, Software Debugging, DevOps, Performance Tuning, Software Deployment, Workflow Management Systems, Azure Data Factory, Apache Spark, Amazon Virtual Private Cloud (VPC), Git, Data Lakes, Pyspark, Cloudwatch, Terraform, Databricks - **Published:** August 4, 2026 - **Apply:** https://www.dice.com/job-detail/45c7f0b8-f706-4c8a-82c0-984efabf7a93 ## About the Role 6 years of experience in data engineering data architecture or big data platform implementation in AWS cloud platform and knowledge in Azure platform as well Strong handson experience with Databricks platform architecture workspace setup cluster configuration jobs notebooks and workflow orchestration Expertise in AWS services such as S3 IAM VPC Glue Lambda CloudWatch and related data platform services Expertise in Azure services such as ADLS Azure Data Factory Azure Synapse Key Vault Entra ID and Azure Monitor Strong knowledge of Apache Spark PySpark SQL Delta Lake and Lakehouse architecture concepts Experience with data security governance access controls Unity Catalog encryption and cloud networking concepts Handson experience with performance tuning cost optimization debugging and production support of Databricks workloads Good understanding of CICD Git Terraform or equivalent infrastructureascode tools and DevOps practices" ## Description We are looking for an experienced AWS Databricks Architect to design implement and optimize scalable Lakehouse solutions across AWS as well as Azure cloud platforms The ideal candidate will provide technical leadership in data architecture platform engineering data governance performance optimization and enterprisegrade Databricks implementations, Design and architect endtoend Databricks Lakehouse solutions across AWS and Azure environments Define scalable data architecture patterns for ingestion transformation storage analytics and reporting workloads Lead implementation of Delta Lake medallion architecture Databricks SQL Unity Catalog and workflow orchestration Optimize Apache Spark jobs clusters notebooks pipelines and workloads for performance reliability and cost efficiency Implement security access control secrets management data governance and compliance best practices across cloud platforms Collaborate with data engineering BI data science DevOps and business teams to deliver highquality data solutions Guide CICD infrastructureascode monitoring alerting and production deployment practices for Databricks workloads Provide technical leadership architecture reviews troubleshooting support and mentoring to project teams ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)