Databricks Architect_
Q1 Technologies, Inc.
Aurora, IL, United States
3 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.thejobnetwork.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source
Tech stack
Artificial Intelligence
Airflow
Amazon S3
Big Data
Data Governance
Extract Transform Load (ETL)
Data Warehousing
Dimensional Modeling
Identity and Access Management
Performance Tuning
Query Optimization
Standard Sql
+18 more
Data Streaming
Sql Optimization
Snowflake
Apache Spark
Data Strategy
Cloudformation
Data Lakes
Pyspark
AWS Lake Formation
AWS Glue
AWS Data Analytics
Real Time Data
Apache Kafka
Terraform
Stream Processing
Data Pipelines
Amazon Elastic Mapreduce (EMR)
Databricks
Requirements
- AWS Data Services - S3, Redshift, Glue, Lambda, Athena.
- Data Modeling - Dimensional Modeling (Star/Snowflake), Data Warehouse Design.
- Data Lake Architecture - Amazon S3, Lake Formation, Data Lake best practices.
- Big Data & Processing - Spark/PySpark, Amazon EMR.
- ETL/ELT Development - AWS Glue, Airflow, Data Pipeline orchestration.
- SQL Expertise - Advanced SQL, query optimization, performance tuning.
- Streaming & Real-Time Data - Kinesis and/or Kafka
- Security & Governance - IAM, KMS, Lake Formation, Encryption, Data Governance.
- Infrastructure as Code - Terraform and/or CloudFormation.
- Architecture & Stakeholder Management - Solution design, cloud migration, business requirement translation.
Roles & Responsibilities
Senior Databricks Architect with strong experience in designing and implementing enterprise-scale
Lakehouse architectures on cloud platforms. Expertise in Databricks, Spark, PySpark, Delta Lake, data modeling, and real-time data processing. Responsible for defining data strategy, architecture standards, governance, and scalable analytics platforms supporting AI/ML and business intelligence initiatives
Generic Managerial Skills, If any
- Strong leadership and stakeholder management skills, with experience leading cross-functional teams and driving delivery excellence.
- Proven effective communication with business and technical stakeholders.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.thejobnetwork.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦