Databricks Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+5 more
Job description
We’re looking for an experienced Databricks Engineer to join an exciting banking and financial services programme, building and managing enterprise-scale Lakehouse platforms. You’ll play a key role in developing secure, scalable and reliable Databricks environments, supporting data engineering teams across multiple environments and cloud platforms. This is a hands-on opportunity involving platform configuration, automation, deployment and performance optimisation. Key Responsibilities: Build and maintain Databricks Lakehouse platforms across development, testing and production environments. Develop data pipelines using PySpark, SQL and Delta Lake. Configure Unity Catalog, permissions, access controls and security policies. Implement CI/CD pipelines and automate platform deployments. Manage Databricks Jobs, Workflows and Declarative Pipelines. Integrate Databricks with AWS services and cloud infrastructure. Support batch and incremental data processing. Optimise platform performance, monitoring and operational reliability.
Requirements
Strong hands-on experience with Databricks and PySpark. Excellent knowledge of Delta Lake and Lakehouse architecture. Experience with Unity Catalog, Autoloader and Structured Streaming. Knowledge of AWS S3, IAM, KMS, Glue and Lambda. Experience with Git, CI/CD and data pipeline development.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…