Data Engineer Azure - GCP

Xcede
London, UK
1 day ago
Apply on www.totaljobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Airflow Microsoft Azure BigQuery Cloud Computing Cloud Database Data Governance Graph Database Identity and Access Management Python (Programming Language) Key Management Role-Based Access Control Google Cloud
+5 more
Git Data Lakes Terraform Data Pipelines Databricks

Job description

We’re looking for a Senior Data Engineer to join a global organisation working on a cross-cloud data engineering initiative, building scalable pipelines between Azure and Google Cloud.

Requirements

  • Strong Python & SQL experience
  • Hands-on Azure Databricks, Delta Lake & Unity Catalog
  • Strong GCP / BigQuery / GCS experience
  • Apache Airflow / Cloud Composer for pipeline orchestration
  • Experience building ELT/data pipelines and cross-cloud data transfers
  • Understanding of IAM, RBAC, secrets management and data governance
  • Experience with data quality, monitoring and pipeline observability
  • Git and ideally Terraform/IaC

Experience with knowledge graphs (e.g. Stardog, Amazon Neptune) and/or pharma/life sciences data environments would be highly desirable.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.totaljobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:30 min

Leveraging BigQuery ML for scalable SQL-based segmentation experiments

Julian Joseph · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

Videos

See all

Related articles

See all