Databricks Architect - (ADLS, S3, or GCS).

VTekis Consulting LLP
Chicago, IL, United States
11 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Query Performance Airflow Amazon Web Services Amazon S3 Cloud Computing Cloud Storage Continuous Integration Data Architecture Data Governance Extract Transform Load (ETL) Data Systems DevOps
+12 more
Performance Tuning Standard Sql Data Streaming Workflow Management Systems Data Processing Azure Data Factory Apache Spark Git Data Lakes Apache Kafka Data Pipelines Databricks

Job description

Design and architect scalable Databricks data solutions. Develop high-performance data pipelines using Spark and Databricks. Optimize data processing, storage, and query performance. Collaborate with business and technical teams to define data architecture. Implement data governance, security, and best practices. Mentor engineering teams and provide technical leadership.

Requirements

13+ years of experience in Data Engineering/Data Architecture. Strong hands-on experience with Databricks and the Lakehouse architecture. Expertise in Apache Spark (PySpark/Scala). Experience with Azure Databricks, AWS Databricks, or GCP Databricks. Strong SQL and data modeling skills. Experience designing and implementing ETL/ELT pipelines. Knowledge of Delta Lake, Unity Catalog, and performance optimization. Experience with cloud storage solutions (ADLS, S3, or GCS). Familiarity with CI/CD, Git, and DevOps practices. Excellent communication and stakeholder management skills. Preferred Skills Experience with streaming data (Kafka, Structured Streaming). Knowledge of orchestration tools such as Airflow or Azure Data Factory. Databricks or Cloud certifications are a plus.

About the company

We provide Recruitment and Staffing services to many industries and domain through our innovative and customized solutions and passionate commitment to research. Ability to understand the hiring strategies, availability of talent and compensation benchmarking makes us proud hiring partner for various industries. We work as trusted business partners and always strive to deliver the most value and highest return on investment for our clients. We are highly trained business professionals with strong understanding of clients need. We work closely with the leading staffing trade associations, training, and research organizations to ensure we are knowledgeable of thustry trends and technologies.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

1:41 min

Visualizing the complex developer journey for JVM ecosystems

Bobur Umurzokov · LIVE

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · WWC Europe 2026

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all

Related articles

See all