Data Architect

Cyber 1 Armor
Milpitas, CA, United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Microsoft Azure Code Review Continuous Integration Data Architecture Information Engineering Data Governance Data Systems Python (Programming Language) Machine Learning Performance Tuning Query Optimization
+18 more
Standard Sql Scala (Programming Language) SQL Databases Data Streaming Enterprise Data Management Azure Service Bus Google Cloud Apache Spark Multi-Cloud Data Lakes Pyspark Collibra Apache Kafka Machine Learning Operations Cloud Migration Terraform Azure Resource Manager Databricks

Job description

We are seeking a hands-on Data Architect with deep expertise in Azure and Databricks to design, build, and optimize enterprise data platforms and products., Design scalable, secure, and cost-effective data architectures on Azure and Databricks

Build data lakehouse solutions using Delta Lake and Medallion Architecture

Develop production-grade Spark applications using PySpark, Scala, and SQL

Design and implement batch and streaming data pipelines

Configure and optimize Databricks environments and Azure services

Implement data governance using Unity Catalog and Azure Purview

Lead architecture reviews, code reviews, and mentor engineering teams

Partner with business and technical stakeholders to deliver modern data solutions

Requirements

8+ years of Data Engineering/Data Architecture experience

Expert-level Databricks (Delta Lake, Unity Catalog, Cluster Optimization)

Strong Azure experience (ADLS, Data Factory, Synapse, Event Hubs, Purview)

Advanced Apache Spark and performance tuning experience

Production coding experience in PySpark, Scala, and/or Python

Strong SQL and query optimization skills

Experience with Lakehouse, Data Mesh, and modern data architectures

Knowledge of Kafka, Event Hubs, and Structured Streaming

Experience with Terraform, ARM Templates, and CI/CD practices

Preferred:

Azure Solutions Architect Expert Certification

Databricks Certified Data Engineer Professional

MLOps and Machine Learning platform experience

Cloud migration and modernization experience

Multi-cloud experience (AWS/Google Cloud Platform)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:34 min

Essential commands for running and testing Terraform configurations

Hennie Francis · LIVE

1:44 min

Career transition into cloud native and data management

Michael Cade · LIVE

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

2:32 min

Overview of Terraform and Terraform Cloud features

Devlin Duldulao · LIVE

Videos

See all

Related articles

See all