Databricks Architect
CLIENT TECHNOLOGY SOLUTIONS LLC
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
IntermediateJob location
Tech stack
Artificial Intelligence
Amazon Web Services (AWS)
Azure
Cloud Computing
Continuous Integration
Data Architecture
Data Governance
Data Systems
Machine Learning
Cloud Services
Systems Integration
Cloud Platform System
Snowflake
Spark
Data Lake
Infrastructure Automation Frameworks
Terraform
Devsecops
Databricks
Job description
We are looking for a hands-on Databricks Architect with strong experience in designing and delivering scalable data and AI solutions in production environments. This role is perfect for someone who enjoys setting architectural direction while remaining deeply technical and hands-on., * Design and implement end-to-end data solutions on Databricks (Spark, Delta Lake, notebooks, jobs, clusters, Lakehouse)
- Define reference architectures, best practices, and standards for data/AI workloads
- Work closely with stakeholders to translate business requirements into scalable Databricks designs
- Implement CI/CD pipelines, DevSecOps practices, and IaC for data platform deployments
- Ensure strong data governance, security, and cost optimisation across cloud environments
- Collaborate across engineering teams to deliver production-grade solutions
Requirements
- 7+ years of data architecture & engineering experience
- 3-4+ years hands-on with Databricks in production environments
- Strong expertise with Spark, Delta Lake, Databricks jobs, notebooks, and cluster management
- Architectural experience defining standards and best practices
- Strong knowledge of at least one cloud platform (Azure, AWS, or GCP)
- Experience with CI/CD, DevSecOps, and infrastructure as code (eg, Terraform)
- Solid understanding of security, governance, and cost management on cloud data platforms
- Excellent stakeholder management and requirement-translation skills
Nice to Have
- Experience integrating Databricks with dbt Cloud, Snowflake, Fivetran, BI tools, etc.
- Background in financial services or capital markets
- Experience with Machine Learning/AI workloads on Databricks