Azure Databricks Architect

Shiro Technologies
Houston, United States
30 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source

Tech stack

Airflow Business Analytics Applications Microsoft Azure Cloud Database Continuous Integration Data Architecture Data Dictionary Information Engineering Data Governance Data Infrastructure Data Security Data Systems
+19 more
Data Warehousing DevOps Python (Programming Language) Performance Tuning Power BI Azure Data Lake SQL Databases Transact-SQL Data Ingestion Azure Data Factory Apache Spark Data Lakes Pyspark Data Analytics Data Management Data Lakehouse Azure Synapse Analytics Data Pipelines Databricks

Job description

Lead the design development and optimization of enterprisescale data platforms and analytics solutions using Azure Databricks Drive data engineering best practices mentor team members and collaborate with business stakeholders to deliver scalable secure and highperformance data solutions This aligns with Chevrons Azurebased Data Analytics ecosystem, * Lead the development of scalable data pipelines and ETLELT frameworks using Azure Databricks and PySpark

  • Architect and optimize data ingestion transformation and consumption layers
  • Design data models data dictionaries and reusable data products
  • Implement data governance quality security and compliance standards
  • Optimize Spark workloads Databricks jobs and overall platform performance
  • Collaborate with business users data scientists and crossfunctional teams to translate requirements into technical solutions
  • Mentor and guide data engineers and junior team members
  • Drive CICD automation and DevOps best practices for data platforms
  • Support Data Lakehouse architecture and enterprise analytics initiatives

Required Skills:

  • Azure Databricks
  • PySpark Apache Spark
  • Python
  • SQL TSQL
  • Azure Data Factory ADF
  • Azure Data Lake Storage ADLS
  • Azure Synapse Analytics
  • Delta Lake
  • Databricks Workflows
  • Data Modeling Data Warehousing
  • Azure DevOps
  • Data Governance Security
  • Performance Tuning and Optimization
  • CICD and Automation Frameworks

Requirements

  • 10 years in Data Engineering Data Platform delivery
  • Strong experience leading Azurebased cloud data transformation programs
  • Proven expertise in enterprisescale Databricks implementations
  • Experience mentoring teams and driving technical governance

Preferred Skills:

  • Unity Catalog
  • Airflow
  • Power BI
  • Lakehouse Architecture
  • DataOpsMLOps exposure
  • Stakeholder management and clientfacing communication

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

Videos

See all

Related articles

See all