Databricks Architects (Resident Solution Architects)

Usg Inc.

San Francisco, CA, United States

1 day ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

10 years minimum

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Amazon Web Services Microsoft Azure Continuous Integration Information Engineering Extract Transform Load (ETL) Data Warehousing DevOps Memory Management Github Performance Tuning Cloud Services Data Streaming

+10 more

Google Cloud Apache Spark Data Lakes Gitlab-ci Data Analytics Data Management Machine Learning Operations Data Pipelines Jenkins Databricks

Job description

Job Description: We’re seeking Databricks Architects (Resident Solution Architects) to lead end-to-end Databricks implementations for public sector engagements - from data platform design through production-grade ETL/ELT delivery on the Databricks Lakehouse Platform.

Requirements

12-15+ years in Data Engineering, Data Platforms, Data Analytics, and Modern Data Warehouse solutions; 10+ years overall consulting/client-facing delivery
Demonstrated success delivering 6-8+ end-to-end Databricks implementations (developer, tech lead, or architect)
Databricks Data Engineering Professional certification (or equivalent); Databricks Solutions Architect Champion program a plus
Strong expertise in cloud-native data platforms across AWS, Azure, and/or Google Cloud Platform
Advanced Apache Spark knowledge - performance optimization, partitioning, execution plans, memory management
Extensive hands-on ETL/ELT pipeline development using Databricks, Delta Lake, Structured Streaming
Experience with DevOps/CI/CD (Azure DevOps, GitHub Actions, GitLab CI/CD, Jenkins)
Working knowledge of MLOps - model deployment and monitoring
Broad understanding of Databricks Lakehouse Platform: Delta Lake, Unity Catalog, Workflows, MLflow, Delta Live Tables
Strong experience tuning large-scale distributed workloads
Public sector experience required