Data Architect
BRIO DIGITAL LTD
London, United Kingdom
3 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.cv-library.co.uk
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Databases
Data Architecture
Data Governance
Extract Transform Load (ETL)
Data Security
Performance Tuning
Datadog
Apache Spark
Data Lakes
Pyspark
Databricks
Job description
We’re looking for a hands-on Data Architect to design a scalable, secure data architecture on AWS, with Databricks as the central engine for all processing and transformation. Data models and tooling are already set, so this role is all about getting the most out of Databricks. You’ll shape the technical design, set governance standards and mentor a team of experienced ETL engineers who are new to Databricks., * Translate project requirements into technical designs that deliver high-performance, cost-effective pipelines
- Bring together source data from files and databases into a single AWS and Databricks platform
- Ensure data is delivered in line with predefined silver and gold models in a Medallion architecture
- Make the right Databricks choices, including storage modes and compute cluster configuration
- Define governance standards, including roles and responsibilities across Databricks and downstream data users
- Work with other architects on best practice for data quality and observability
- Mentor data engineers new to Databricks through hands-on guidance, training and reusable patterns
Requirements
- Strong AWS experience
- Deep hands-on Databricks experience, including performance and cost optimisation
- Proven experience delivering Medallion architecture
- Strong ETL background
- Experience setting data governance standards
- Confident mentoring and upskilling engineering teams
Desirable
- Unity Catalog
- PySpark and Spark performance tuning
- Delta Lake
- Data quality and observability tooling
- Experience leading a team’s move onto Databricks
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.cv-library.co.uk
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…