Senior Databricks Architect

Qode View all jobs
Austin, United States of America
8 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 146K

Job location

Austin, United States of America

Tech stack

Artificial Intelligence
Airflow
Amazon Web Services (AWS)
Azure
Cloud Engineering
Data Architecture
Information Engineering
Data Governance
ETL
Dataspaces
Data Systems
Distributed Systems
Python
Node.js
Standard Sql
Data Streaming
Cloud Platform System
Spark
Backend
Data Lake
PySpark
Kafka
Data Management
Machine Learning Operations
Stream Processing
Data Pipelines
Databricks

Job description

We are seeking an experienced Senior Databricks Architect to design and deliver scalable, high-performance data platforms for our Financial Services clients. The ideal candidate will have deep expertise in Databricks, cloud data architectures, and modern data engineering practices, with a strong focus on building governed, secure, and efficient data ecosystems., * Architect and implement end-to-end data solutions using Databricks Lakehouse Platform

  • Design and develop scalable data pipelines using PySpark, Spark, and SQL
  • Lead cloud data platform implementations on AWS/Azure/GCP
  • Drive modernization of legacy data systems to cloud-native architectures
  • Implement Medallion Architecture (Bronze, Silver, Gold layers)
  • Ensure data governance, security, and compliance (especially for Financial Services)
  • Collaborate with business stakeholders, data scientists, and engineering teams
  • Optimize performance, cost, and reliability of data pipelines
  • Mentor and guide data engineering teams and provide architectural leadership., As a Senior Backend Engineer specializing in Node.js and AWS, you will play a pivotal role in shaping the future of AI systems. Your expertise will contribute to the development of…
  • 1 month ago, As a Senior Backend Engineer specializing in Python, you will play a critical role in shaping the future of AI systems. Your expertise will directly influence how models learn, rea…
  • 1 month ago

Requirements

  • 12+ years of experience in Data Engineering / Data Architecture
  • Strong expertise in Databricks, PySpark, and Spark ecosystem
  • Hands-on experience with cloud platforms (Azure, AWS, or GCP)
  • Experience with data orchestration tools (Airflow, ADF, etc.)
  • Solid understanding of data modeling, ETL/ELT, and distributed systems
  • Experience with Delta Lake and Unity Catalog is a plus
  • Strong knowledge of Financial Services domain (Banking, Insurance, Capital Markets)
  • Excellent problem-solving and stakeholder management skills., * Databricks certifications
  • Experience with real-time data processing (Kafka, streaming)
  • Exposure to AI/ML pipelines and MLOps
  • Knowledge of regulatory and compliance frameworks in Financial Services

Apply for this position