Senior Data Engineer (VMware cloud) [qt355]

SKM Group
UK
3 months ago
Apply on uk.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
4 years minimum
Compensation
£45,000.0 - £102,000.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Amazon S3 Microsoft Azure Bash Shell Databases Data as a Services Data Validation Information Engineering Data Governance Data Loss Disaster Recovery Distributed Data Store
+19 more
Failover Python (Programming Language) NoSQL Performance Tuning Redis Prometheus Search Technologies VCloud Ceph (Software) Azure Data Factory Grafana Apache Spark Data Lakes Kubernetes Storage Technologies Information Technology Cosmos DB Databricks Vmware

Job description

This strategic initiative involves migrating enterprise data services, object storage, and caching layers from Microsoft Azure to VMware Cloud Foundation (VCF). The goal is to ensure zero data loss and seamless business continuity while building an AI-ready data platform for the future., As a Senior Data Engineer, you will own the migration workstream, designing end-to-end strategies for databases and storage services. You will lead the technical implementation of VMware DSM and vector databases, ensuring a secure, scalable, and high-performance transition.

Tech Stack

VMware Cloud Foundation (VCF), VMware Data Services Manager (DSM), Azure Data Platforms, Cosmos DB, Redis, MinIO, Ceph, Qdrant, Python, Bash, NoSQL, S3-compatible storage, Pinecone, Weaviate, Milvus, Delta Lake, Databricks, Spark, Azure Networking, Kubernetes, Prometheus, Grafana, ELK, Retrieval-Augmented Generation (RAG) architectures, Vector search.

What You’ll Do

  • Lead the migration of enterprise data services and Cosmos DB workloads from Azure to VMware Cloud Foundation and Data Services Manager (DSM).
  • Design and execute complex migration patterns, including dual-write, cutover, reconciliation, and rollback strategies to ensure zero data loss.
  • Deploy and optimize Redis Operator for caching and manage large-scale object storage using MinIO and Ceph.
  • Enable AI capabilities by implementing and managing Qdrant and other vector databases to support semantic search and RAG architectures.
  • Develop automation and operational tooling using Python and Bash for migration monitoring and platform management.
  • Collaborate with infrastructure and security teams to define disaster recovery, failover, and data governance standards.

Requirements

  • 5+ years of experience in Data Engineering, Database Engineering, or Infrastructure Engineering.
  • Proven track record of leading large-scale cloud-to-cloud migrations with minimal downtime.
  • Deep hands-on expertise with VMware Cloud Foundation (VCF) and Azure data platforms.
  • Experience with distributed databases, NoSQL, and S3-compatible storage architectures.
  • Strong background in data validation, quality frameworks, and performance optimization.
  • Bachelor’s or Master’s degree in Computer Science, IT, or a related technical field., * VMWare: 4 years (required)

Benefits & conditions

  • Attractive salary
  • Large freedom and real influence
  • No unhealthy competition, team approach to meeting challenges
  • Remote-first, flexible working culture
  • Company apartments in cool cities across Europe: work and enjoy a memorable getaway

About the company

We are a software house with 18 years of experience and a global portfolio of projects. We help businesses modernize, scale, and innovate through custom software solutions. Our team embraces unconventional ideas and new technologies, delivering solutions with real impact. If you value professionalism, creativity, and a strong engineering culture, you’ll feel at home here.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on uk.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

4:36 min

Hiring passionate software engineers to tackle unprecedented scaling challenges

Dana Lawson Dana Lawson +1 · World Congress 2026 Europe

1:40 min

Managing containerized infrastructure with Podman Desktop

Cedric Clyburn Cedric Clyburn +1 · World Congress 2025

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

3:55 min

Demonstrating semantic routing thresholds with the Redis vector library

1:44 min

Career transition into cloud native and data management

Michael Cade · LIVE

1:41 min

Parallels between cloud and legacy infrastructure lock-ins

Björn Stahl Björn Stahl · World Congress 2024

Videos

See all

Related articles

See all