Databricks Architect
Simarn LLC
Downers Grove, IL, United States
about 1 month ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.disabledperson.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Microsoft Azure
Software Code Optimization
Information Systems
Continuous Integration
Data Architecture
Information Engineering
Data Governance
Data Infrastructure
Extract Transform Load (ETL)
Data Warehousing
DevOps
+16 more
Identity and Access Management
Power BI
DataOps
SQL Databases
Data Streaming
Tableau (Software)
Enterprise Data Management
Apache Spark
Data Lakes
Pyspark
Information Technology
Apache Kafka
Data Management
Machine Learning Operations
Data Pipelines
Databricks
Job description
We are looking for an experienced Databricks Architect to design and lead enterprise-scale data platforms and lakehouse solutions. This role will focus on Databricks architecture, cloud data engineering, streaming, governance, migration, and platform optimization across Azure, AWS, or GCP., * Lead migrations of legacy data warehouses and ETL workloads to Databricks.
- Architect batch and real-time/streaming pipelines using Spark.
- Define data governance, security, access controls, and enterprise data standards.
- Drive platform performance, scalability, reliability, and cost optimization.
- Establish CI/CD, monitoring, DataOps, and operational best practices.
- Partner with data engineers, data scientists, cloud architects, and business stakeholders.
- Provide architectural guidance and technical leadership to engineering teams.
Requirements
- 8+ years of data engineering/data platform experience.
- 3+ years of hands-on Databricks architecture experience.
- Strong expertise in Apache Spark, PySpark, SQL, and Delta Lake.
- Experience with Azure Databricks, AWS Databricks, or GCP Databricks.
- Strong streaming experience with Kafka, Azure Event Hubs, AWS Kinesis, or GCP Pub/Sub.
- Hands-on understanding of producer/consumer architectures and design trade-offs.
- Experience with lakehouse architecture, data governance, orchestration, security, and access management.
Nice to Have
- Experience with Unity Catalog, Delta Live Tables, and Databricks Workflows.
- Databricks certification.
- Experience with Power BI or Tableau.
- Knowledge of DataOps, DevOps, and MLOps.
Bachelor’s degree in computer science, Engineering, Information Systems, or a related field preferred.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.disabledperson.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…