Databricks Architect
Gazelle Global Consulting
Manchester, United Kingdom
2 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.totaljobs.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Amazon S3
Big Data
Continuous Integration
Distributed Computing Environment
Identity and Access Management
Performance Tuning
Standard Sql
Data Streaming
Data Lakes
Pyspark
Infrastructure Automation Frameworks
+3 more
Terraform
Data Pipelines
Databricks
Requirements
- Strong hands-on experience with Databricks, including Notebooks, Jobs and Workflows.
- Advanced PySpark and SQL skills for large-scale data processing.
- Experience with Delta Lake and Unity Catalog.
- Knowledge of Databricks Autoloader and Structured Streaming.
- Experience building batch and incremental data pipelines.
- Strong understanding of Lakehouse and Medallion architecture.
- AWS experience covering S3, IAM, KMS, Glue and Lambda.
- Experience migrating AWS-native workloads to Databricks.
- Knowledge of Terraform, Infrastructure as Code and CI/CD.
- Strong understanding of distributed data processing and performance tuning.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.totaljobs.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦