Data Architect - Databricks/AWS
CUSTOM STAFFING INC
New York, NY, United States
6 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$208,000.0
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Data Analysis
Cloud Database
Data Architecture
Information Engineering
Extract Transform Load (ETL)
Data Security
Data Warehousing
Database Design
Identity and Access Management
Python (Programming Language)
Standard Sql
+12 more
SQL Databases
Tableau (Software)
Apache Spark
Pyspark
Gitlab-ci
Infrastructure Automation Frameworks
Information Technology
AWS Data Analytics
Data Management
Machine Learning Operations
Data Pipelines
Databricks
Job description
We are seeking an experienced Data Architect to design scalable enterprise data solutions using Databricks and AWS. This role will lead cloud data architecture, data pipelines, governance, modeling and analytics within a complex, highly regulated environment., * Architect Databricks and AWS data platforms for large-scale analytical workloads.
- Design ETL/ELT pipelines, lakehouse solutions and dimensional data models.
- Integrate Unity Catalog, AWS IAM and cross-account data access.
- Develop standards for PySpark, Python, Spark and SQL.
- Establish data quality, governance, security and access-control frameworks.
- Optimize compute, storage, clusters and overall platform costs.
- Implement GitLab CI/CD and Infrastructure as Code practices.
- Design semantic layers for Tableau and BI reporting.
- Support MLOps and generative AI initiatives.
- Partner with technical and business teams and mentor data engineers.
Requirements
- Databricks and Unity Catalog
- AWS cloud data architecture
- PySpark, Python, Spark and SQL
- ETL/ELT pipelines
- Data modeling and governance
- GitLab CI/CD and Infrastructure as Code
- Tableau and BI architecture, * Bachelor’s degree in computer science or a related field.
- 8+ years of data architecture, data engineering or database design experience.
- Extensive Databricks and AWS cloud data architecture experience.
- Strong PySpark, Python, Spark, SQL and ETL/ELT expertise.
- Expert knowledge of data modeling, lakehouses, data warehouses and governance.
- Experience delivering secure, scalable and highly available data platforms.
- Strong communication and cross-functional leadership skills.
- Tableau, MLOps and Domino Data Lab experience preferred.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
BB
Benedikt Bischof
about 4 years ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
EM
Eli McGarvie
Data Engineer Salary UK
about 3 years ago
MH
Michael Hunger
Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?
7 months ago
EM
Eli McGarvie
Data Analyst Salary in the UK
about 3 years ago