Azure Databricks Platform Architect / Solution Architect
Purplejack Technologies Llc
Raritan, United States
26 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Artificial Intelligence
Amazon Web Services
Data Architecture
Data Discovery
Data Governance
Data Infrastructure
Extract Transform Load (ETL)
Data Security
Cloud Services
Migration Manager
Data Lakes
Data Lineage
+2 more
Data Pipelines
Databricks
Job description
- Architecture & Strategy
- Define end-to-end migration strategy from Azure Databricks to AWS Databricks.
- Design scalable Lakehouse architecture using Medallion principles (Bronze, Silver, Gold).
- Develop Day 1 Business Continuity and Day 2 Modernization / AI Enablement migration roadmaps.
- Perform application and dependency assessments across upstream and downstream systems.
- Establish architecture patterns, standards, and best practices for cloud-native data platforms.
- Migration & Modernization
- Lead migration of data pipelines, notebooks, Delta tables, workflows, and data products.
- Modernize legacy ETL/ELT frameworks using Databricks native capabilities.
- Optimize performance, scalability, security, and operational efficiency.
- Define migration approaches for CDC, batch, streaming, and real-time workloads.
- Drive technology rationalization and tool consolidation initiatives.
- AI-Ready Data Platform
- Build AI-ready data foundations leveraging Delta Lake and Unity Catalog.
- Design data architectures supporting ML, GenAI, RAG, feature stores, and advanced analytics.
- Enable governed data access for data scientists and AI applications.
- Define semantic models, metadata strategies, lineage, and data discovery frameworks.
- Establish frameworks for AI governance and responsible AI adoption.
- Data Governance & Security
- Architect enterprise-wide governance using Unity Catalog.
- Design data lineage, auditing, access controls, masking, and compliance standards.
Requirements
- 15+ Years of experience
- Azure Databricks
- AWS Databricks
- Lakehouse architecture
- Medallion principles (Bronze, Silver, Gold)
- Delta Lake
- Unity Catalog
- ML
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦