Lead Solution Cloud Architect Azure Databricks

K-Tek Resourcing LLC
Minneapolis, MN, United States
10 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$150,000.0 - $160,000.0
Working hours
Regular working hours
Job source

Tech stack

Unity 3d Artificial Intelligence Data Analysis Microsoft Azure Cloud Computing Continuous Integration Data Architecture Information Engineering Data Governance Data Integration Extract Transform Load (ETL) Data Systems
+25 more
DevOps Distributed Computing Environment Data Flow Control Identity and Access Management Information Systems Security Architecture Professional Python (Programming Language) Meta-Data Management Role-Based Access Control Azure Active Directory SQL Databases Data Streaming Azure Service Bus Apache Spark HybridCloud Data Lakes Pyspark Infrastructure Automation Frameworks Collibra Bicep Data Management Machine Learning Operations Terraform Azure Synapse Analytics Data Pipelines Databricks

Job description

  • Architect enterprise-grade cloud and data solutions using Microsoft Azure services including Azure VMs, Blob Storage, Data Factory, Functions, Event Hubs, Azure AD, and Synapse Analytics.
  • Design scalable Databricks Lakehouse architectures leveraging Spark, Delta Lake, Unity Catalog, MLflow, governance, and MLOps.
  • Architect scalable ETL/ELT pipelines, real-time streaming solutions, and reusable data integration frameworks.
  • Develop HLDs, LLDs, architecture blueprints, data-flow diagrams, integration patterns, security architectures, and deployment models.
  • Design hybrid cloud/on-premises data platforms using ADLS, ADF, Azure Databricks, Synapse, Purview, and Azure DevOps.
  • Lead requirements discovery and translate business objectives into technical architectures and modernization roadmaps.
  • Provide hands-on technical direction to data engineering, analytics, DevOps, and platform teams.
  • Establish standards for data governance, CI/CD, infrastructure automation, security, and environment management.
  • Evaluate existing architectures and recommend improvements for scalability, resiliency, performance, security, and cost optimization.
  • Serve as the technical SME for client workshops, architecture discussions, and executive presentations.
  • Partner with business and technology stakeholders to define solution vision, roadmap, and success metrics.

Requirements

We are seeking an accomplished Lead Solution Cloud Architect with 12-15 years of experience designing, implementing, and governing enterprise cloud and data architectures. The ideal candidate will bring deep expertise in Microsoft Azure and Databricks, combined with strong solution architecture, technical leadership, and stakeholder management skills., * 12-15+ years of overall IT experience in cloud, data engineering, and enterprise architecture.

  • 5+ years of Microsoft Azure architecture experience.
  • 5+ years of Databricks experience with Spark, Delta Lake, Unity Catalog, and MLflow.
  • Strong hands-on experience with Python, SQL, PySpark, and distributed data processing.
  • Strong knowledge of data modeling, data governance, metadata management, and security.
  • Experience with CI/CD, Terraform, Azure Bicep/ARM Templates, GitOps, and automation.
  • Strong Azure networking knowledge including VNets, NSGs, Private Endpoints, Azure AD/Entra ID, RBAC, encryption, and identity governance.
  • Understanding of enterprise security frameworks such as NIST and CIS.
  • Excellent architecture, communication, presentation, and stakeholder-management skills.

Preferred Skills

  • Azure Solutions Architect certification.
  • Databricks certifications.
  • Experience with Azure Purview/Microsoft Purview.
  • Experience designing MLOps and AI/ML data platforms.
  • Experience with real-time streaming and Event Hubs.
  • Strong experience leading enterprise cloud modernization programs.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:56 min

Provisioning a secure container infrastructure with Bicep

Matthias Falkenberg +1 · World Congress 2022

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:09 min

Selecting infrastructure tools and determining proper abstraction layers

Alayshia Knighten Alayshia Knighten · World Congress 2024

3:46 min

Navigating a career in cloud transformation consulting

Piet Van Dongen · LIVE

Videos

See all

Related articles

See all