Databricks Architect
SPAR Group
San Francisco, CA, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Microsoft Azure
Continuous Integration
Information Engineering
Data Infrastructure
Extract Transform Load (ETL)
Data Systems
Data Warehousing
DevOps
Memory Management
Github
Machine Learning
+14 more
Performance Tuning
Cloud Services
Data Streaming
Data Processing
Google Cloud
Apache Spark
Data Lakes
Gitlab-ci
Data Analytics
Data Management
Machine Learning Operations
Data Pipelines
Jenkins
Databricks
Requirements
- 12-15+ years of experience in Data Engineering, Data Platforms, Data Analytics, and Modern Data Warehouse solutions, with 10+ years of overall consulting and client-facing delivery experience.
- Demonstrated success delivering 6-8+ end-to-end Databricks implementations, serving as a hands-on developer, technical lead, or solution architect.
- Databricks Data Engineering Professional certification (or equivalent advanced Databricks certification) with completion of all recommended learning paths and coursework.
- Databricks has a Databricks Solutions Architect Champion program- this will be good to have
- Strong expertise in designing and implementing cloud-native data platforms across AWS, Azure, and/or Google Cloud Platform, with deep hands-on proficiency in at least one cloud ecosystem.
- Advanced knowledge of Apache Spark, including performance optimization, partitioning strategies, execution plans, memory management, and Spark runtime internals.
- Extensive hands-on experience developing scalable ETL/ELT pipelines using Databricks, Delta Lake, Structured Streaming, and modern data engineering frameworks.
- Experience implementing DevOps and CI/CD practices for production-grade data solutions using tools such as Azure DevOps, GitHub Actions, GitLab CI/CD, or Jenkins.
- Working knowledge of MLOps principles, machine learning lifecycle management, model deployment, and monitoring within enterprise environments.
- Current and broad understanding of the Databricks Lakehouse Platform, including Delta Lake, Unity Catalog, Workflows, MLflow, Delta Live Tables, and other platform capabilities.
- Strong experience tuning large-scale distributed workloads and designing highly performant, scalable, and cost-efficient data processing solutions.
Ability to troubleshoot complex data platform challenges and recommend architecture patterns aligned with business and technical requirements
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
BB
Benedikt Bischof
about 4 years ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago
AJ
Austin Joy
What Are The Top Skills Required For Azure Developers?
over 4 years ago
MH
Michael Hunger
Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?
8 months ago
EM
Eli McGarvie
Data Engineer Salary UK
about 3 years ago
CH
Chris Heilmann
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production
almost 2 years ago