Databricks Architect

CLIENT TECHNOLOGY SOLUTIONS LLC
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Tech stack

Artificial Intelligence
Amazon Web Services (AWS)
Azure
Cloud Computing
Continuous Integration
Data Architecture
Data Governance
Data Systems
Machine Learning
Cloud Services
Systems Integration
Cloud Platform System
Snowflake
Spark
Data Lake
Infrastructure Automation Frameworks
Terraform
Devsecops
Databricks

Job description

We are looking for a hands-on Databricks Architect with strong experience in designing and delivering scalable data and AI solutions in production environments. This role is perfect for someone who enjoys setting architectural direction while remaining deeply technical and hands-on., * Design and implement end-to-end data solutions on Databricks (Spark, Delta Lake, notebooks, jobs, clusters, Lakehouse)

  • Define reference architectures, best practices, and standards for data/AI workloads
  • Work closely with stakeholders to translate business requirements into scalable Databricks designs
  • Implement CI/CD pipelines, DevSecOps practices, and IaC for data platform deployments
  • Ensure strong data governance, security, and cost optimisation across cloud environments
  • Collaborate across engineering teams to deliver production-grade solutions

Requirements

  • 7+ years of data architecture & engineering experience
  • 3-4+ years hands-on with Databricks in production environments
  • Strong expertise with Spark, Delta Lake, Databricks jobs, notebooks, and cluster management
  • Architectural experience defining standards and best practices
  • Strong knowledge of at least one cloud platform (Azure, AWS, or GCP)
  • Experience with CI/CD, DevSecOps, and infrastructure as code (eg, Terraform)
  • Solid understanding of security, governance, and cost management on cloud data platforms
  • Excellent stakeholder management and requirement-translation skills

Nice to Have

  • Experience integrating Databricks with dbt Cloud, Snowflake, Fivetran, BI tools, etc.
  • Background in financial services or capital markets
  • Experience with Machine Learning/AI workloads on Databricks

Apply for this position