Data Engineer Azure - GCP
Xcede
London, UK
about 1 month ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.totaljobs.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source
Tech stack
Airflow
Microsoft Azure
BigQuery
Cloud Computing
Cloud Database
Data Governance
Graph Database
Identity and Access Management
Python (Programming Language)
Key Management
Role-Based Access Control
Google Cloud
+5 more
Git
Data Lakes
Terraform
Data Pipelines
Databricks
Job description
We’re looking for a Senior Data Engineer to join a global organisation working on a cross-cloud data engineering initiative, building scalable pipelines between Azure and Google Cloud.
Requirements
- Strong Python & SQL experience
- Hands-on Azure Databricks, Delta Lake & Unity Catalog
- Strong GCP / BigQuery / GCS experience
- Apache Airflow / Cloud Composer for pipeline orchestration
- Experience building ELT/data pipelines and cross-cloud data transfers
- Understanding of IAM, RBAC, secrets management and data governance
- Experience with data quality, monitoring and pipeline observability
- Git and ideally Terraform/IaC
Experience with knowledge graphs (e.g. Stardog, Amazon Neptune) and/or pharma/life sciences data environments would be highly desirable.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.totaljobs.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…