Databricks Resident Solutions Architect

eSolutionsFirst LLC

Vienna, VA, United States

4 days ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Experience level

Experienced

Experience required

3 years minimum

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Unity 3d Artificial Intelligence Amazon Web Services Continuous Integration Data Architecture Information Engineering Extract Transform Load (ETL) DevOps Distributed Computing Environment Python (Programming Language) Machine Learning Performance Tuning

+16 more

Cloud Services RSA (Cryptosystem) Search Technologies SQL Databases Data Streaming Google Cloud Large Language Models Apache Spark Generative AI Data Lakes Pyspark Data Management Machine Learning Operations Stream Processing Data Pipelines Databricks

Job description

We are seeking an experienced Databricks Resident Solutions Architect (RSA) to lead the architecture, implementation, and optimization of enterprise Databricks Lakehouse solutions., * Lead the architecture and delivery of enterprise Databricks Lakehouse implementations.
Design scalable solutions using Databricks, Delta Lake, Apache Spark, Unity Catalog, and Databricks Workflows.
Provide hands-on technical leadership for complex Databricks data engineering projects.
Optimize Spark and Databricks workloads for performance, scalability, reliability, and cost.
Design and implement enterprise ETL/ELT pipelines using Databricks, Spark, Python, and SQL.
Establish Unity Catalog governance, security, access controls, and data management practices.
Support migration and modernization of legacy data platforms to Databricks Lakehouse.
Implement CI/CD and DevOps practices for Databricks deployments.
Partner with data science teams on MLflow, MLOps, machine learning, and GenAI/LLM workloads.
Troubleshoot complex Databricks, Spark, Delta Lake, and pipeline issues.
Conduct architecture workshops and advise customers on Databricks best practices and roadmap.
Mentor engineering teams and serve as a trusted technical advisor to customer stakeholders.

Requirements

This is a hands-on, customer-facing role requiring deep Databricks expertise, strong architecture skills, and the ability to guide engineering and data teams., * 7+ years of experience in data engineering, data architecture, or cloud data platforms.
3+ years of hands-on Databricks experience with multiple enterprise implementations.
Strong expertise in:
Databricks Lakehouse Platform
Delta Lake
Apache Spark
Unity Catalog
Databricks Workflows/Jobs
Databricks SQL
ETL/ELT and data engineering

Strong Python, SQL, and PySpark skills.

Experience with Azure Databricks, AWS Databricks, or Databricks on Google Cloud Platform.

Strong understanding of Spark performance tuning and distributed processing.

Experience with CI/CD, MLOps, and MLflow.

Experience with Databricks governance, security, and data architecture.

Strong customer-facing consulting, communication, and presentation skills.

U.S. work authorization without current or future visa sponsorship.

Preferred Qualifications

Databricks Certified Data Engineer Professional certification.
Databricks Solutions Architect certification.
Experience with Generative AI, LLMs, Vector Search, Model Serving, and Mosaic AI.
Experience with Structured Streaming and real-time data processing.
Experience migrating enterprise data warehouses/data lakes to Databricks.
Experience in consulting or professional services environments.