Digital Consulting - Databricks Technical Architect - Manager

Huron Consulting Group Inc.
Chicago, IL, United States
about 2 months ago
Apply on huron.wd1.myworkdayjobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
4 years minimum
Compensation
$145,000.0 - $170,000.0
Working hours
Regular working hours

Tech stack

Adobe InDesign Artificial Intelligence Amazon Web Services Data Analysis Microsoft Azure Cloud Computing Information Systems Continuous Integration Data Architecture Information Engineering Data Governance Data Integration
+23 more
Github Identity and Access Management Python (Programming Language) Machine Learning Cloud Services Salesforce.Com Search Technologies SQL Databases Data Streaming Google Cloud Large Language Models Snowflake Generative AI Amazon Virtual Private Cloud (VPC) Microsoft Fabric Data Lakes Pyspark Information Technology Data Management Machine Learning Operations Terraform Data Pipelines Databricks

Job description

We are looking for a Databricks Technical Architect to design, stand up, and productionalize Lakehouse platforms for our clients. You will translate business requirements into technical architecture, lead hands-on platform builds, design and deploy medallion data pipelines, and extend Databricks with native ML and GenAI capabilities to power conversational BI and intelligent data integration workflows. You will partner closely with Huron functional and domain leads-who own the business, governance, and MDM side-so that your focus stays where you deliver the most value: the platform, the pipelines, and the applied AI.

Responsibilities

Stand up and configure Databricks environments end-to-end-workspace and account architecture, Unity Catalog design, metastore strategy, cluster and SQL warehouse policies, networking (VPC/PrivateLink), IAM/SCIM, and cost governance.

Design and deploy medallion (bronze/silver/gold) data pipelines using Delta Lake, Auto Loader, Delta Live Tables / Lakeflow Declarative Pipelines, Structured Streaming, and CDC patterns.

Establish infrastructure-as-code and CI/CD foundations using Databricks Asset Bundles, Terraform, and GitHub Actions or Azure DevOps.

Build applied AI solutions on Mosaic AI-Agent Framework, Vector Search, Model Serving, MLflow-including conversational BI experiences (Genie, AI/BI, ai_query, SQL AI Functions) and LLM-assisted data integration workflows (schema matching, entity resolution, source-to-target mapping acceleration, PII detection).

Optimize Delta Lake performance (Z-order, liquid clustering, OPTIMIZE/VACUUM, schema evolution) and design for scalability, reliability, and cost efficiency.

Integrate Databricks with the broader enterprise stack via Lakehouse Federation, Delta Sharing, and zero-copy interop with Salesforce Data Cloud, Snowflake, and Microsoft Fabric.

Partner with functional and MDM/data governance leads so that platform decisions support downstream data quality, mastering, and stewardship workflows.

Document and communicate architecture decisions to internal and external stakeholders.

Establish and refine delivery accelerators, reference architectures, guardrails, and automated review patterns.

Lead technical workstreams, mentor data and ML engineers, and coach client technology partners.

Requirements

Bachelor’s degree in Computer Science, Engineering, Information Systems or related field.

At least 4 years of hands-on experience with Databricks, within a broader background in data engineering, cloud data platforms, and analytics architecture.

Databricks Certified Data Engineer Professional or Machine Learning Professional (required).

Cloud-agnostic capability across AWS, Azure, and GCP, with AWS experience preferred.

Deep hands-on expertise with Delta Lake, Unity Catalog, Delta Live Tables / Lakeflow, Structured Streaming, and Databricks Workflows.

Working experience with Mosaic AI (Agent Framework, Vector Search, Model Serving), MLflow, Feature Store, and Genie / AI/BI for conversational analytics.

Proficiency in Python, SQL, and PySpark; comfort with Scala a plus.

Experience with infrastructure-as-code (Terraform, Databricks Asset Bundles) and CI/CD for data platforms.

Familiarity with Lakehouse Federation, Delta Sharing, and interop patterns with Salesforce Data Cloud, Snowflake, or Microsoft Fabric.

Exposure to MDM, data quality, or data governance workflows a plus.

Excellent communication, collaboration, and problem-solving skills.

The estimated base salary for this job is $145,000 - $170,000. The range represents a good faith estimate of the range that Huron reasonably expects to pay for this job at the time of the job posting. The actual salary paid to an individual will vary based on multiple factors, including but not limited to specific skills or certifications, years of experience, market changes, and required travel. This job is also eligible to participate in Huron’s annual incentive compensation program, which reflects Huron’s pay for performance philosophy. Inclusive of annual incentive compensation opportunity, the total estimated compensation range for this job is $174,000 - $204,000. The job is also eligible to participate in Huron’s benefit plans which include medical, dental and vision coverage and other wellness programs. The salary range information provided is in accordance with applicable state and local laws regarding salary transparency that are currently in effect and may be implemented in the future.

Position Level

Manager

About the company

Huron is a global consultancy that collaborates with clients to drive strategic growth, ignite innovation and navigate constant change. Through a combination of strategy, expertise and creativity, we help clients accelerate operational, digital and cultural transformation, enabling the change they need to own their future.

Join our team as the expert you are now and create your future.

You’ve built real technical depth in the consulting arena. But you find yourself wondering what’s next on your career agenda. You want to keep sharpening what you do best-hands-on architecture, platform engineering, applied AI-while stepping into a role with more scope and visibility. Huron has your answer-our Technical Manager position on the Data Management & Analytics team. Our tech managers work alongside Huron and client team members to lead the full implementation lifecycle-planning, platform standup, architecture and design, build, migration, enablement, go-live, and post-production support. It’s a highly-dynamic position-with considerable visibility into how modern data platforms actually get delivered.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on huron.wd1.myworkdayjobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · World Congress 2023

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:34 min

Essential commands for running and testing Terraform configurations

Hennie Francis · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:40 min

Using GitHub primitives for internal documentation and corporate operations

Kyle Daigle · Coffee With Developers

1:34 min

Transitioning from traditional software development to artificial intelligence consulting

Patrick Schnell Patrick Schnell · Coffee With Developers

Videos

See all

Related articles

See all