> Markdown version of [/jobs/ext/1928192-databrics-architect](https://www.wearedevelopers.com/jobs/ext/1928192-databrics-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Databrics Architect - **Company:** PamTen - **Location:** United States - **Contract:** Permanent contract - **Skills:** Microsoft Azure, Big Data, Continuous Integration, Data Governance, Extract Transform Load (ETL), Data Transformation, Data Security, Data Warehousing, DevOps, Python (Programming Language), SQL Azure, Performance Tuning, SQL Databases, Data Logging, Scripting, Azure Data Factory, Apache Spark, Infrastructure as Code (IaC), Cloudformation, Containerization, Data Lakes, Kubernetes, Machine Learning Operations, Terraform, Data Pipelines, Serverless Computing, Docker, Databricks - **Published:** August 5, 2026 - **Apply:** https://www2.jobdiva.com/portal/?a=rijdnwzhw0mz36cpr0zwxqcj9yt1m405eam52pzlcqh06kjpfrmqaa2uyt3eiarf&compid=0/jobs/28450407#/jobs/28450407 ## About the Role * Engineering Degree - BE/ME/BTech/MTech/BSc/MSc. * Technical certification in multiple technologies is desirable., * Deep understanding of Azure services, including but not limited to Azure Data Factory, Azure Storage, Azure SQL, Azure Functions, etc. Proficiency in Databricks, Apache Spark, and related big data technologies. * Strong scripting skills in Python, SQL, and experience with Terraform or CloudFormation. * Excellent problem-solving skills and the ability to work in a fast-paced environment. * Experience with Kubernetes, Docker, and containerized applications. Familiarity with data lake architectures, Delta Lake, and advanced analytics solutions. Strong understanding of CI/CD pipelines, DevOps practices, and Infrastructure as Code (IaC). ## Description * Design and architect scalable, high-performance, and cost-effective cloud-based solutions using Azure services and Databricks. Develop comprehensive architecture blueprints that include data pipelines, data warehousing, and advanced analytics solutions. * Architect and implement big data processing solutions using Databricks, leveraging Apache Spark for data transformation, ETL processes, and machine learning workflows. Design data pipelines that handle large-scale data ingestion, processing, and storage. * Implement data security, data governance, and compliance measures within the Databricks environment using Unity Catalog. * Work closely with Data engineers, DevOps teams, and other stakeholders to ensure seamless integration of solutions. Collaborate with project managers and business analysts to gather and interpret requirements, ensuring technical feasibility and alignment with business objectives. * Analyze and optimize system performance, identifying bottlenecks and implementing solutions to enhance processing speed and efficiency. Implement monitoring tools and strategies to proactively manage the health and performance of the Azure and Databricks environments. * Ensure that all solutions adhere to security best practices and compliance requirements, including data encryption, access control, and logging. Implement strategies to protect sensitive data and ensure compliance with relevant regulations, such as GDPR, HIPAA, etc. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Database DevOps with Containers](https://www.wearedevelopers.com/videos/145-database-devops-with-containers) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Dev Digest 159: AI Pipelines, 10x Faster TypeScript, How to Interview](https://www.wearedevelopers.com/magazine/563-dev-digest-159-ai-pipelines-10x-faster-typescript-how-to-interview)