Senior Databricks Architect

Qode LLC

Gunnison County, CO, United States

3 months ago

Apply on www.indeed.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Working hours

Regular working hours

Job source

www.indeed.com

Tech stack

Artificial Intelligence Airflow Amazon Web Services Microsoft Azure Cloud Engineering Data Architecture Information Engineering Data Governance Extract Transform Load (ETL) Dataspaces Data Systems Distributed Systems

+12 more

Standard Sql Data Streaming Cloud Platform System Apache Spark Data Lakes Pyspark Apache Kafka Data Management Machine Learning Operations Stream Processing Data Pipelines Databricks

Job description

We are seeking an experienced Senior Databricks Architect to design and deliver scalable, high-performance data platforms for our Financial Services clients. The ideal candidate will have deep expertise in Databricks, cloud data architectures, and modern data engineering practices, with a strong focus on building governed, secure, and efficient data ecosystems., * Architect and implement end-to-end data solutions using Databricks Lakehouse Platform

Design and develop scalable data pipelines using PySpark, Spark, and SQL
Lead cloud data platform implementations on AWS/Azure/GCP
Drive modernization of legacy data systems to cloud-native architectures
Implement Medallion Architecture (Bronze, Silver, Gold layers)
Ensure data governance, security, and compliance (especially for Financial Services)
Collaborate with business stakeholders, data scientists, and engineering teams
Optimize performance, cost, and reliability of data pipelines
Mentor and guide data engineering teams and provide architectural leadership.

Requirements

12+ years of experience in Data Engineering / Data Architecture
Strong expertise in Databricks, PySpark, and Spark ecosystem
Hands-on experience with cloud platforms (Azure, AWS, or GCP)
Experience with data orchestration tools (Airflow, ADF, etc.)
Solid understanding of data modeling, ETL/ELT, and distributed systems
Experience with Delta Lake and Unity Catalog is a plus
Strong knowledge of Financial Services domain (Banking, Insurance, Capital Markets)
Excellent problem-solving and stakeholder management skills., * Databricks certifications
Experience with real-time data processing (Kafka, streaming)
Exposure to AI/ML pipelines and MLOps
Knowledge of regulatory and compliance frameworks in Financial Services