Databricks Architect

IBM
Wimbledon, ND, United States
2 days ago
Apply on computerjobs.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Adobe Experience Manager Microsoft Azure Batch Processing Data Architecture Data Infrastructure Data Integration Data Transformation Data Systems Push Technology Identity and Access Management Cloud Services Azure Data Lake
+8 more
SAP (Applications) Customer Identity Access Management Adobe Data Lakes Data Management Stream Processing Data Pipelines Databricks

Job description

We’re seeking an experienced Databricks Architect to join a high-profile data transformation programme focused on delivering customer engagement and marketing analytics capabilities. This is an initial 3-month contract with a strong likelihood of extension, offering predominantly remote working with approximately one day per week onsite in Wimbledon.

This role would suit a senior consultant or architect who combines deep technical expertise in Azure and Databricks with strong stakeholder management and delivery leadership skills. The Role

You will take ownership of the end-to-end solution architecture for a modern Azure-based data platform, integrating multiple operational data sources into Adobe Experience Manager (AEM) to support personalised customer communications, push notifications and campaign analytics.

Working alongside IBM delivery teams and directly with client stakeholders, you’ll be responsible for shaping the solution, driving technical decisions, leading offshore development resources and ensuring successful delivery from design through implementation.

The solution includes both near Real Time and batch processing requirements, requiring scalable, secure and cost-effective architecture., * Gather and define business and technical requirements with stakeholders

  • Design end-to-end Azure Databricks architectures
  • Produce high-level and detailed solution designs
  • Lead the setup and governance of Databricks environments
  • Define and manage technical workstreams for engineering teams
  • Provide architectural oversight throughout delivery
  • Lead and coordinate offshore developers and engineers
  • Develop capacity planning and cost modelling for the platform
  • Collaborate with Adobe-focused teams responsible for downstream integrations
  • Ensure best practice across data management, performance, security and scalability

Technical Environment

  • Microsoft Azure
  • Azure Databricks
  • Azure Data Lake
  • Delta Lake
  • Data Integration & Transformation
  • Near Real-Time Data Processing
  • Adobe Experience Manager (AEM)

Key Data Sources

  • SAP CIAM (Customer Identity & Access Management)
  • Secutix ticketing platform
  • Teamcard scanning and attendance data
  • Tournament management and match data systems

Requirements

  • Strong Azure Databricks architecture experience
  • Proven delivery of enterprise-scale cloud data platforms
  • Deep understanding of modern data architecture patterns
  • Experience designing and implementing scalable data solutions within Azure
  • Strong stakeholder engagement and consulting skills
  • Experience leading offshore or distributed engineering teams
  • Ability to provide technical leadership from discovery through delivery
  • Experience producing cost estimates, sizing models and implementation plans

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on computerjobs.com
Prepare application

Good distractions

Loading talks and stories from around this role…