Databricks Architect / Enterprise Data Architect

Ascii Group, LLC

Malvern, PA, United States

6 days ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

8 years minimum

Compensation

$158,080.0

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Artificial Intelligence Airflow Amazon Web Services Amazon S3 Microsoft Azure Big Data Continuous Integration Data Architecture Data Governance Extract Transform Load (ETL) DevOps Identity and Access Management

+21 more

Cloud Services Data Streaming Apache Spark State Machines Cloudformation Data Lakes Pyspark Data Lineage AWS Glue Data Analytics Star Schema AWS Data Analytics Apache Kafka Data Management Physical Data Models Functional Programming Terraform Stream Processing Stream Analytics Amazon Redshift Databricks

Job description

Enterprise Architecture & Lakehouse Design: Architect and deploy secure, scalable, high-performance Data Lake and Lakehouse platforms on AWS and Azure leveraging Databricks.
Data Modeling & Warehousing: Design robust conceptual, logical, and physical data models, including Star and Snowflake schemas, for Amazon Redshift and enterprise data warehouses.
Big Data & Pipeline Engineering: Lead complex ETL/ELT development using Apache Spark, PySpark, AWS Glue, Lambda, Step Functions, and Airflow.
Real-Time Analytics & Streaming: Implement real-time streaming architectures utilizing Amazon Kinesis, Kafka, or MSK.
Governance, Security & IaC: Enforce enterprise data governance, encryption, data lineage, and security (IAM, KMS, Lake Formation) while implementing Infrastructure as Code via Terraform or CloudFormation.

Requirements

Seeking a highly skilled Databricks Architect / Data Architect with 8-10 years of experience to design and implement enterprise-scale data platforms in Malvern, PA (100% on-site). The ideal candidate will possess deep expertise in Data Lakes, Lakehouse architectures, Databricks, AWS data stack (S3, Redshift, Athena, Glue, Lambda), and real-time data processing solutions. Responsibilities include conceptualizing, logically and physically modeling enterprise data ecosystems, enforcing security and governance, and optimizing big data processing for AI/ML and analytics initiatives., * Core Experience: 10 to 20 years of experience in Data Architecture, enterprise big data engineering, and cloud data platforms.

Databricks & Lakehouse: Direct hands-on architecture experience with Databricks, Apache Spark, and Lakehouse architectures.
AWS Data Stack: Advanced expertise in Amazon S3, Redshift, Athena, Lake Formation, AWS Glue, and EMR.
Data Modeling: Demonstrated mastery of Star/Snowflake schemas, conceptual, logical, and physical modeling.
DevOps & Governance: Strong skills in IaC (Terraform/CloudFormation), CI/CD, IAM, KMS, and data lineage framework implementation.
On-Site Commitment: Absolute willingness and availability to work 100% on-site in Malvern, PA.

Preferred Qualifications

Official Databricks Certified Data Engineer Professional or AWS Certified Data Analytics / Solutions Architect.
Prior experience delivering real-time streaming architectures for large-scale enterprise analytics.