Azure Databricks Architect
Shiro Technologies
Houston, United States
3 months ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source
Tech stack
Airflow
Business Analytics Applications
Microsoft Azure
Cloud Database
Continuous Integration
Data Architecture
Data Dictionary
Information Engineering
Data Governance
Data Infrastructure
Data Security
Data Systems
+19 more
Data Warehousing
DevOps
Python (Programming Language)
Performance Tuning
Power BI
Azure Data Lake
SQL Databases
Transact-SQL
Data Ingestion
Azure Data Factory
Apache Spark
Data Lakes
Pyspark
Data Analytics
Data Management
Data Lakehouse
Azure Synapse Analytics
Data Pipelines
Databricks
Job description
Lead the design development and optimization of enterprisescale data platforms and analytics solutions using Azure Databricks Drive data engineering best practices mentor team members and collaborate with business stakeholders to deliver scalable secure and highperformance data solutions This aligns with Chevrons Azurebased Data Analytics ecosystem, * Lead the development of scalable data pipelines and ETLELT frameworks using Azure Databricks and PySpark
- Architect and optimize data ingestion transformation and consumption layers
- Design data models data dictionaries and reusable data products
- Implement data governance quality security and compliance standards
- Optimize Spark workloads Databricks jobs and overall platform performance
- Collaborate with business users data scientists and crossfunctional teams to translate requirements into technical solutions
- Mentor and guide data engineers and junior team members
- Drive CICD automation and DevOps best practices for data platforms
- Support Data Lakehouse architecture and enterprise analytics initiatives
Required Skills:
- Azure Databricks
- PySpark Apache Spark
- Python
- SQL TSQL
- Azure Data Factory ADF
- Azure Data Lake Storage ADLS
- Azure Synapse Analytics
- Delta Lake
- Databricks Workflows
- Data Modeling Data Warehousing
- Azure DevOps
- Data Governance Security
- Performance Tuning and Optimization
- CICD and Automation Frameworks
Requirements
- 10 years in Data Engineering Data Platform delivery
- Strong experience leading Azurebased cloud data transformation programs
- Proven expertise in enterprisescale Databricks implementations
- Experience mentoring teams and driving technical governance
Preferred Skills:
- Unity Catalog
- Airflow
- Power BI
- Lakehouse Architecture
- DataOpsMLOps exposure
- Stakeholder management and clientfacing communication
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦