Databricks Data Engineer
Hays plc
Charing Cross, United Kingdom
6 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
EnglishJob location
Remote
Charing Cross, United Kingdom
Tech stack
Azure
Continuous Integration
Information Engineering
Data Governance
Distributed Data Store
Power BI
Data Lake
PySpark
Azure
Serverless Computing
Databricks
Job description
Data Engineer - Active SC, Databricks, PySpark
Up to £475 per day (Inside IR35)
Remote / London
6 months
My client is an International Consultancy who are recruiting for an Data Engineer with Active Security Clearance (SC) and strong Databricks and Azure experience to deliver and optimise Data engineering solutions.
Key requirements:
- Proven experience as a Data Engineer with Active Security Clearance (SC)
- Strong experience with Databricks, PySpark and Delta Lake
- Expertise in Jobs & Workflows, cluster tuning, and performance optimisation
- Solid understanding of Data governance (Unity Catalog, Lineage, Access Policies)
- Hands-on with Azure services: Data Lake Storage (Gen2), Key Vault, Azure Functions
- Familiarity with CI/CD for Databricks deployments
- Strong troubleshooting in distributed Data environments
- Excellent communication and collaboration skills
Nice to have:
- Immediate availability
- Experience with enterprise-scale Databricks environments
- Knowledge of Azure Synapse, Power BI and cost optimisation strategies
If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.
If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career. #4750695 - Lauren
Requirements
- Proven experience as a Data Engineer with Active Security Clearance (SC)
- Strong experience with Databricks, PySpark and Delta Lake
- Expertise in Jobs & Workflows, cluster tuning, and performance optimisation
- Solid understanding of Data governance (Unity Catalog, Lineage, Access Policies)
- Hands-on with Azure services: Data Lake Storage (Gen2), Key Vault, Azure Functions
- Familiarity with CI/CD for Databricks deployments
- Strong troubleshooting in distributed Data environments
- Excellent communication and collaboration skills
Nice to have:
- Immediate availability
- Experience with enterprise-scale Databricks environments
- Knowledge of Azure Synapse, Power BI and cost optimisation strategies
