Data Platform Engineer - ADF, Terraform, Synapse, Spark
Hays plc
Charing Cross, United Kingdom
3 days ago
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Compensation
£ 208KJob location
Charing Cross, United Kingdom
Tech stack
Azure
ETL
Cloud Services
T-SQL
Azure
Spark
Data Lake
Terraform
Azure
Serverless Computing
Job description
We are currently working with a client who urgently require a Data Platform Engineer with hands on expertise in Synapse Spark Architecture, ADF and Terraform (IaC), to assist in designing and delivering complex cloud solutions.
Requirements
- Proven, hands-on experience with Microsoft Azure as a Data Platform Engineer
- Advanced knowledge of Azure Data Factory (ADF), including network configurations and integration runtime options.
- Strong expertise in Synapse Analytics Spark, Azure Key Vault, and Data Lake Storage Accounts.
- Experience in efficient handling of large-scale data
- Deep understanding of Azure DevOps pipelines and deploying Terraform (Infrastructure as Code).
- Proven experience in platform migration projects and delivering secure, scalable cloud solutions.
Nice to have:
- Immediate availability
- Understanding of Synapse Spark Architecture
- Familiarity with a variety of technologies, including Apache Spark, Spark ML, Serverless Spark Pools, TSQL, ETL