Databricks Engineer
Gazelle Global Consulting
Manchester, United Kingdom
2 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.adzuna.co.uk
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
Β£59,805
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Amazon S3
Cloud Computing
Continuous Integration
Data Architecture
Identity and Access Management
SQL Databases
Data Streaming
Data Processing
Git
Data Lakes
Pyspark
+2 more
Data Pipelines
Databricks
Job description
- Build and maintain Databricks Lakehouse platforms across development, testing and production environments.
- Develop data pipelines using PySpark, SQL and Delta Lake.
- Configure Unity Catalog, permissions, access controls and security policies.
- Implement CI/CD pipelines and automate platform deployments.
- Manage Databricks Jobs, Workflows and Declarative Pipelines.
- Integrate Databricks with AWS services and cloud infrastructure.
- Support batch and incremental data processing.
- Optimise platform performance, monitoring and operational reliability.
Requirements
- Strong hands-on experience with Databricks and PySpark.
- Excellent knowledge of Delta Lake and Lakehouse architecture.
- Experience with Unity Catalog, Autoloader and Structured Streaming.
- Knowledge of AWS S3, IAM, KMS, Glue and Lambda.
- Experience with Git, CI/CD and data pipeline development.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.adzuna.co.uk
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦