Databricks Architect

Q1 Technologies, Inc.
Aurora, IL, United States
7 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Unity 3d Airflow Amazon Web Services Amazon S3 Continuous Integration Data Architecture Data Governance Extract Transform Load (ETL) Data Warehousing Identity and Access Management Performance Tuning Data Streaming
+9 more
Apache Spark Data Lakes Pyspark Real Time Data Apache Kafka Terraform Stream Processing Amazon Redshift Databricks

Job description

Databricks Architect - 14+ years Malvern PA Senior Databricks Architect with strong experience in designing and implementing enterprise-scale Lakehouse architectures on cloud platforms. Expertise in Databricks, Spark, PySpark, Delta Lake, data modeling, and real-time data processing. Databricks Architect, Databricks Lakehouse, Apache Spark, PySpark, Delta Lake, Unity Catalog, Structured Streaming, Kafka, Data Modeling, ETL, ELT, AWS, S3, Redshift, Glue, Airflow, Terraform, CI/CD, Data Governance, Lakehouse Architecture, Performance Tuning What is the Databricks Lakehouse architecture, and how is it different from a traditional Data Warehouse? What is Delta Lake, and what benefits do ACID transactions provide in Databricks? How have you optimized Spark/Databricks jobs for performance and cost? Can you explain the difference between Spark transformations and actions? What is Unity Catalog, and how have you used it for data governance and security? How would you design a real-time data ingestion pipeline in Databricks? Look for: Kafka, Structured Streaming, Delta Live Tables. What is your experience with AWS services integrated with Databricks? Look for: S3, Glue Catalog, IAM, Redshift, Lambda. Databricks Architect - 14+ years Malvern PA Senior Databricks Architect with strong experience in designing and implementing enterprise-scale Lakehouse architectures on cloud platforms. Expertise in Databricks, Spark, PySpark, Delta Lake, data modeling, and real-time data processing. Databricks Architect, Databricks Lakehouse, Apache Spark, PySpark, Delta Lake, Unity Catalog, Structured Streaming, Kafka, Data Modeling, ETL, ELT, AWS, S3, Redshift, Glue, Airflow, Terraform, CI/CD, Data Governance, Lakehouse Architecture, Performance Tuning What is the Databricks Lakehouse architecture, and how is it different from a traditional Data Warehouse? What is Delta Lake, and what benefits do ACID transactions provide in Databricks? How have you optimized Spark/Databricks jobs for performance and cost? Can you explain the difference between Spark transformations and actions? What is Unity Catalog, and how have you used it for data governance and security? How would you design a real-time data ingestion pipeline in Databricks? Look for: Kafka, Structured Streaming, Delta Live Tables. What is your experience with AWS services integrated with Databricks? Look for: S3, Glue Catalog, IAM, Redshift, Lambda.

Requirements

Senior Databricks Architect with strong experience in designing and implementing enterprise-scale Lakehouse architectures on cloud platforms. Expertise in Databricks, Spark, PySpark, Delta Lake, data modeling, and real-time data processing.

About the company

Databricks Architect, Databricks Lakehouse, Apache Spark, PySpark, Delta Lake, Unity Catalog, Structured Streaming, Kafka, Data Modeling, ETL, ELT, AWS, S3, Redshift, Glue, Airflow, Terraform, CI/CD, Data Governance, Lakehouse Architecture, Performance Tuning

  • What is the Databricks Lakehouse architecture, and how is it different from a traditional Data Warehouse?
  • What is Delta Lake, and what benefits do ACID transactions provide in Databricks?
  • How have you optimized Spark/Databricks jobs for performance and cost?
  • Can you explain the difference between Spark transformations and actions?
  • What is Unity Catalog, and how have you used it for data governance and security?
  • How would you design a real-time data ingestion pipeline in Databricks?
  • Look for: Kafka, Structured Streaming, Delta Live Tables.
  • What is your experience with AWS services integrated with Databricks?
  • Look for: S3, Glue Catalog, IAM, Redshift, Lambda.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…