> Markdown version of [/jobs/ext/4010374-databricks-specialist](https://www.wearedevelopers.com/jobs/ext/4010374-databricks-specialist). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Databricks Specialist

- **Company:** Q1 Technologies, Inc.
- **Location:** Aurora, IL, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, Microsoft Azure, Big Data, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Python (Programming Language), Performance Tuning, Software Engineering, SQL Databases, Cloud Platform System, Delivery Pipeline, Apache Spark, Data Lakes, Machine Learning Operations, Data Pipelines, Databricks
- **Published:** October 29, 2026
- **Apply:** https://www.thejobnetwork.com/job/cde4a5e8-4567-43f5-a97e-1fb8324d4293/databricks-specialist

## About the Role

Experience: 5 to 10 years in data engineering, software development, or solution architecture, with hands-on Databricks production experience.

Technical Stack: Strong proficiency in Python, SQL, or Scala; deep knowledge of Apache Spark runtime internals and Delta Lake.

Cloud Ecosystems: Working knowledge of major cloud platforms like Microsoft Azure, AWS, or GCP.

Certifications: Preferred credentials include Databricks Certified Data Engineer or Solutions Architect credentials. []

## Description

Architecture & Development: Design end-to-end data pipelines, ETL/ELT processes, and lakehouse storage patterns using Apache Spark, Delta Lake, and Python or SQL.

 - Performance Tuning: Optimize cluster sizing, query execution, shuffles, partitions, and storage layouts for large-scale data workflows. [1]

 - AI & Machine Learning Integration: Implement MLOps workflows, manage model lifecycles, or deploy generative AI and vector search solutions using tools like MLflow and Unity Catalog. [1]

 - Collaboration & Consulting: Partner with enterprise stakeholders, data scientists, and software engineers to translate business requirements into technical solutions. [1]

 - Administration & Governance: Oversee security configurations, access controls, workspace administration, and CI/CD deployment pipelines