Senior Azure Databricks Solutions Architect
QUASENT INC.
Chicago, IL, United States
3 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerboard.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source
Tech stack
Unity 3d
Artificial Intelligence
Microsoft Azure
Information Engineering
Data Governance
Data Infrastructure
Data Integration
Software Design Patterns
Oracle (Applications)
Azure Machine Learning
Azure Data Lake
SQL Databases
+6 more
Enterprise Search
Large Language Models
Multi-Agent Systems
Data Lakes
Pyspark
Databricks
Job description
- You will be responsible for the Architecture and design.
- Lead the Architecture and Technical Design of Enterprise-scale Data Platform.
- Own the end-to-end technical architecture of the data platform including ingestion layers, bronze and silver scd layers, data modelling, consumption channel integration, and Real Time speed layer design.
- Define and govern architecture standards, design patterns, and technical guardrails across all delivery workstreams
- Lead technical design reviews and ensure alignment between functional requirements, source-to-target mappings, and technical implementation.
- Architect solutions using Azure Databricks, Delta Lake, Unity Catalog, ADLS, GEN2, and Azure Services.
- Evaluate and recommend technology decisions across the Azure and Databricks ecosystem - including Delta Lake, Unity Catalog, Mosaic AI, Databricks Apps, Azure AI Search, and Azure Data Lake Storage Gen2
- Drive architecture for Databricks Genie AI/BI - defining the Genie space design, semantic layer approach, and self-service analytics enablement strategy.
- Lead the design and expansion of an agentic delivery framework - defining multi-agent architecture, orchestration patterns, LLM integration, and knowledge base design using Databricks Mosaic AI and Azure AI services technical leadership
- Serve as the technical escalation point for the delivery team - resolving complex data engineering, integration, and platform challenges
- Guide data engineers, functional SMEs, and report developers on technical approach and best practices on the Databricks platform
- Support downstream data integrations, including Oracle GoldenGate (OCG) replication, data views, and provisioning patterns.
- Review and approve technical designs, data models, and solution specifications before build.
- Provide architectural oversight on schema change impact, upstream dependency management, and data quality framework design Stakeholder and cross-program engagement.
- Engage with client architects to align on platform decisions, architectural governance, and technology approvals.
- Represent the technical position in cross-program forums spanning source systems, downstream channel teams, and enterprise platform teams.
- Support architecture decisions for consumption channel integrations including OGG replication, view design, and data provisioning patterns
Requirements
- 10 plus years of experience in I.T. with strong expertise in data engineering and solution architecture.
- Strong hands on experience with Azure Databricks, PySpark, Spart, SQL, Delta Lake, and ADLS Gen2.
- Experience with Unity Catalog, data governance, and security
- Proven experience leading technical teams and enterprise architecture discussions.
Preferred Skills:
- Databricks Genie AI/BI and semantic layer architecture.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerboard.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦