Senior Azure Databricks Solutions Architect

QUASENT INC.
Chicago, IL, United States
3 days ago
Apply on www.careerboard.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours

Tech stack

Unity 3d Artificial Intelligence Microsoft Azure Information Engineering Data Governance Data Infrastructure Data Integration Software Design Patterns Oracle (Applications) Azure Machine Learning Azure Data Lake SQL Databases
+6 more
Enterprise Search Large Language Models Multi-Agent Systems Data Lakes Pyspark Databricks

Job description

  • You will be responsible for the Architecture and design.
  • Lead the Architecture and Technical Design of Enterprise-scale Data Platform.
  • Own the end-to-end technical architecture of the data platform including ingestion layers, bronze and silver scd layers, data modelling, consumption channel integration, and Real Time speed layer design.
  • Define and govern architecture standards, design patterns, and technical guardrails across all delivery workstreams
  • Lead technical design reviews and ensure alignment between functional requirements, source-to-target mappings, and technical implementation.
  • Architect solutions using Azure Databricks, Delta Lake, Unity Catalog, ADLS, GEN2, and Azure Services.
  • Evaluate and recommend technology decisions across the Azure and Databricks ecosystem - including Delta Lake, Unity Catalog, Mosaic AI, Databricks Apps, Azure AI Search, and Azure Data Lake Storage Gen2
  • Drive architecture for Databricks Genie AI/BI - defining the Genie space design, semantic layer approach, and self-service analytics enablement strategy.
  • Lead the design and expansion of an agentic delivery framework - defining multi-agent architecture, orchestration patterns, LLM integration, and knowledge base design using Databricks Mosaic AI and Azure AI services technical leadership
  • Serve as the technical escalation point for the delivery team - resolving complex data engineering, integration, and platform challenges
  • Guide data engineers, functional SMEs, and report developers on technical approach and best practices on the Databricks platform
  • Support downstream data integrations, including Oracle GoldenGate (OCG) replication, data views, and provisioning patterns.
  • Review and approve technical designs, data models, and solution specifications before build.
  • Provide architectural oversight on schema change impact, upstream dependency management, and data quality framework design Stakeholder and cross-program engagement.
  • Engage with client architects to align on platform decisions, architectural governance, and technology approvals.
  • Represent the technical position in cross-program forums spanning source systems, downstream channel teams, and enterprise platform teams.
  • Support architecture decisions for consumption channel integrations including OGG replication, view design, and data provisioning patterns

Requirements

  • 10 plus years of experience in I.T. with strong expertise in data engineering and solution architecture.
  • Strong hands on experience with Azure Databricks, PySpark, Spart, SQL, Delta Lake, and ADLS Gen2.
  • Experience with Unity Catalog, data governance, and security
  • Proven experience leading technical teams and enterprise architecture discussions.

Preferred Skills:

  • Databricks Genie AI/BI and semantic layer architecture.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerboard.com
Prepare application

Good distractions

Loading talks and stories from around this role…