Data Architect

Cyber 1 Armor
Milpitas, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Milpitas, United States of America

Tech stack

Amazon Web Services (AWS)
Azure
Code Review
Continuous Integration
Data Architecture
Information Engineering
Data Governance
Data Systems
Python
Machine Learning
Performance Tuning
Query Optimization
Standard Sql
Scala
SQL Databases
Data Streaming
Enterprise Data Management
Azure
Google Cloud Platform
Spark
Multi-Cloud
Data Lake
PySpark
Collibra
Kafka
Machine Learning Operations
Cloud Migration
Terraform
Azure
Databricks

Job description

We are seeking a hands-on Data Architect with deep expertise in Azure and Databricks to design, build, and optimize enterprise data platforms and products., Design scalable, secure, and cost-effective data architectures on Azure and Databricks

Build data lakehouse solutions using Delta Lake and Medallion Architecture

Develop production-grade Spark applications using PySpark, Scala, and SQL

Design and implement batch and streaming data pipelines

Configure and optimize Databricks environments and Azure services

Implement data governance using Unity Catalog and Azure Purview

Lead architecture reviews, code reviews, and mentor engineering teams

Partner with business and technical stakeholders to deliver modern data solutions

Requirements

8+ years of Data Engineering/Data Architecture experience

Expert-level Databricks (Delta Lake, Unity Catalog, Cluster Optimization)

Strong Azure experience (ADLS, Data Factory, Synapse, Event Hubs, Purview)

Advanced Apache Spark and performance tuning experience

Production coding experience in PySpark, Scala, and/or Python

Strong SQL and query optimization skills

Experience with Lakehouse, Data Mesh, and modern data architectures

Knowledge of Kafka, Event Hubs, and Structured Streaming

Experience with Terraform, ARM Templates, and CI/CD practices

Preferred:

Azure Solutions Architect Expert Certification

Databricks Certified Data Engineer Professional

MLOps and Machine Learning platform experience

Cloud migration and modernization experience

Multi-cloud experience (AWS/Google Cloud Platform)

Apply for this position