Databricks Lead/Solution Architect

Acunor Inc
Minneapolis, MN, United States
8 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$140,000.0 - $170,000.0
Working hours
Regular working hours

Tech stack

Clean Code Principles Unity 3d Data Analysis Microsoft Azure Batch Processing Cloud Computing Cloud Engineering Continuous Integration Data Architecture Information Engineering Data Governance Extract Transform Load (ETL)
+29 more
Data Systems DevOps Distributed Computing Environment Data Flow Control Identity and Access Management Python (Programming Language) Meta-Data Management Role-Based Access Control Azure Active Directory Azure Data Lake SQL Databases Data Streaming Azure Data Factory Apache Spark HybridCloud Data Lakes Pyspark Git Flow Infrastructure Automation Frameworks Information Technology Bicep Data Management Machine Learning Operations CIS Benchmarks Terraform Azure Synapse Analytics Data Pipelines Serverless Computing Databricks

Job description

We are looking for an experienced Databricks Lead / Solution Architect to design and lead enterprise-scale cloud and modern data platform solutions. This is a senior, hands-on architecture role requiring strong expertise across Microsoft Azure, Databricks Lakehouse, data engineering, governance, security, and cloud architecture. The ideal candidate will bring 12 15 years of overall IT experience, strong architectural leadership, and the ability to translate business requirements into scalable, secure, and cost-efficient technical solutions. Key Responsibilities

  • Architect enterprise-scale cloud and data solutions using Microsoft Azure and Databricks.
  • Design Databricks Lakehouse architectures leveraging Spark, Delta Lake, Unity Catalog, MLflow, governance, and MLOps patterns.
  • Architect scalable ETL/ELT pipelines, batch processing, and real-time streaming solutions.
  • Design hybrid cloud/on-premise data platforms using Azure Data Lake Storage, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Event Hubs, Azure Functions, Microsoft Entra ID (Azure AD), and Microsoft Purview.
  • Create HLDs, LLDs, data-flow diagrams, integration patterns, deployment models, and security reference architectures.
  • Lead requirements discovery and translate business needs into solution architectures and technical roadmaps.
  • Guide Data Engineering, Analytics, DevOps, and Platform teams through implementation and optimization.
  • Conduct architecture assessments and identify opportunities to improve scalability, reliability, performance, security, and cloud cost efficiency.
  • Establish engineering standards around CI/CD, infrastructure automation, data governance, security, coding practices, and environment management.
  • Serve as a technical SME during client workshops, architecture discussions, and executive presentations., Job Category: Data Management Job Description: About the Role EXL Service is seeking an accomplished Data (DBX) Leader with 12-15 years of progressive experience in designing…
  • 29 days ago

Requirements

  • 12 15 years of experience across data engineering, cloud platforms, and enterprise architecture.
  • 5+ years of hands-on Azure architecture experience delivering production-grade solutions.
  • 5+ years of strong Databricks experience, including Spark, Delta Lake, Unity Catalog, and MLflow.
  • Strong hands-on expertise in Python, SQL, PySpark, and distributed data processing.
  • Deep understanding of data modeling, data governance, metadata management, lineage, and modern data architecture.
  • Experience with Terraform, Azure Bicep/ARM Templates, CI/CD, GitOps, and infrastructure automation.
  • Strong understanding of Azure security and networking, including VNets, NSGs, Private Endpoints, RBAC, encryption, identity governance, and Microsoft Entra ID.
  • Knowledge of enterprise security frameworks such as NIST and CIS benchmarks.
  • Strong client-facing communication and the ability to influence both technical and business stakeholders.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:56 min

Provisioning a secure container infrastructure with Bicep

Matthias Falkenberg +1 · World Congress 2022

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:09 min

Selecting infrastructure tools and determining proper abstraction layers

Alayshia Knighten Alayshia Knighten · World Congress 2024

3:38 min

Architecting a unified data and machine learning workbench

Kapil Gupta Kapil Gupta · World Congress 2025

Videos

See all

Related articles

See all