Data Architect

BRIO DIGITAL LTD
London, United Kingdom
3 days ago
Apply on www.cv-library.co.uk
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Amazon Web Services Databases Data Architecture Data Governance Extract Transform Load (ETL) Data Security Performance Tuning Datadog Apache Spark Data Lakes Pyspark Databricks

Job description

We’re looking for a hands-on Data Architect to design a scalable, secure data architecture on AWS, with Databricks as the central engine for all processing and transformation. Data models and tooling are already set, so this role is all about getting the most out of Databricks. You’ll shape the technical design, set governance standards and mentor a team of experienced ETL engineers who are new to Databricks., * Translate project requirements into technical designs that deliver high-performance, cost-effective pipelines

  • Bring together source data from files and databases into a single AWS and Databricks platform
  • Ensure data is delivered in line with predefined silver and gold models in a Medallion architecture
  • Make the right Databricks choices, including storage modes and compute cluster configuration
  • Define governance standards, including roles and responsibilities across Databricks and downstream data users
  • Work with other architects on best practice for data quality and observability
  • Mentor data engineers new to Databricks through hands-on guidance, training and reusable patterns

Requirements

  • Strong AWS experience
  • Deep hands-on Databricks experience, including performance and cost optimisation
  • Proven experience delivering Medallion architecture
  • Strong ETL background
  • Experience setting data governance standards
  • Confident mentoring and upskilling engineering teams

Desirable

  • Unity Catalog
  • PySpark and Spark performance tuning
  • Delta Lake
  • Data quality and observability tooling
  • Experience leading a team’s move onto Databricks

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.cv-library.co.uk
Prepare application

Good distractions

Loading talks and stories from around this role…