Databricks Engineer

Gazelle Global Consulting
Epsom, United Kingdom
1 day ago
Apply on www.apply4u.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Amazon Web Services Amazon S3 Cloud Computing System Configuration Continuous Integration Data Architecture Information Engineering Identity and Access Management Performance Tuning SQL Databases Data Streaming Data Processing
+5 more
Git Data Lakes Pyspark Data Pipelines Databricks

Job description

We’re looking for an experienced Databricks Engineer to join an exciting banking and financial services programme, building and managing enterprise-scale Lakehouse platforms. You’ll play a key role in developing secure, scalable and reliable Databricks environments, supporting data engineering teams across multiple environments and cloud platforms. This is a hands-on opportunity involving platform configuration, automation, deployment and performance optimisation. Key Responsibilities: Build and maintain Databricks Lakehouse platforms across development, testing and production environments. Develop data pipelines using PySpark, SQL and Delta Lake. Configure Unity Catalog, permissions, access controls and security policies. Implement CI/CD pipelines and automate platform deployments. Manage Databricks Jobs, Workflows and Declarative Pipelines. Integrate Databricks with AWS services and cloud infrastructure. Support batch and incremental data processing. Optimise platform performance, monitoring and operational reliability.

Requirements

Strong hands-on experience with Databricks and PySpark. Excellent knowledge of Delta Lake and Lakehouse architecture. Experience with Unity Catalog, Autoloader and Structured Streaming. Knowledge of AWS S3, IAM, KMS, Glue and Lambda. Experience with Git, CI/CD and data pipeline development.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.apply4u.co.uk
Prepare application

Good distractions

Loading talks and stories from around this role…