Senior Data Engineer (VMware cloud) [qt355]

SKM Group
14 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 102K

Job location

Remote

Tech stack

Artificial Intelligence
Amazon Web Services (AWS)
Azure
Bash
Databases
Data as a Services
Data Validation
Information Engineering
Data Governance
Data Loss
Disaster Recovery
Distributed Data Store
Failover
Python
NoSQL
Performance Tuning
Redis
Prometheus
Search Technologies
VCloud
Ceph
Azure
Grafana
Spark
Data Lake
Kubernetes
Storage Technologies
Information Technology
Cosmos DB
Databricks
VMware

Job description

This strategic initiative involves migrating enterprise data services, object storage, and caching layers from Microsoft Azure to VMware Cloud Foundation (VCF). The goal is to ensure zero data loss and seamless business continuity while building an AI-ready data platform for the future., As a Senior Data Engineer, you will own the migration workstream, designing end-to-end strategies for databases and storage services. You will lead the technical implementation of VMware DSM and vector databases, ensuring a secure, scalable, and high-performance transition.

Tech Stack

VMware Cloud Foundation (VCF), VMware Data Services Manager (DSM), Azure Data Platforms, Cosmos DB, Redis, MinIO, Ceph, Qdrant, Python, Bash, NoSQL, S3-compatible storage, Pinecone, Weaviate, Milvus, Delta Lake, Databricks, Spark, Azure Networking, Kubernetes, Prometheus, Grafana, ELK, Retrieval-Augmented Generation (RAG) architectures, Vector search.

What You'll Do

  • Lead the migration of enterprise data services and Cosmos DB workloads from Azure to VMware Cloud Foundation and Data Services Manager (DSM).
  • Design and execute complex migration patterns, including dual-write, cutover, reconciliation, and rollback strategies to ensure zero data loss.
  • Deploy and optimize Redis Operator for caching and manage large-scale object storage using MinIO and Ceph.
  • Enable AI capabilities by implementing and managing Qdrant and other vector databases to support semantic search and RAG architectures.
  • Develop automation and operational tooling using Python and Bash for migration monitoring and platform management.
  • Collaborate with infrastructure and security teams to define disaster recovery, failover, and data governance standards.

Requirements

  • 5+ years of experience in Data Engineering, Database Engineering, or Infrastructure Engineering.
  • Proven track record of leading large-scale cloud-to-cloud migrations with minimal downtime.
  • Deep hands-on expertise with VMware Cloud Foundation (VCF) and Azure data platforms.
  • Experience with distributed databases, NoSQL, and S3-compatible storage architectures.
  • Strong background in data validation, quality frameworks, and performance optimization.
  • Bachelor's or Master's degree in Computer Science, IT, or a related technical field., * VMWare: 4 years (required)

Benefits & conditions

  • Attractive salary
  • Large freedom and real influence
  • No unhealthy competition, team approach to meeting challenges
  • Remote-first, flexible working culture
  • Company apartments in cool cities across Europe: work and enjoy a memorable getaway

About the company

We are a software house with 18 years of experience and a global portfolio of projects. We help businesses modernize, scale, and innovate through custom software solutions. Our team embraces unconventional ideas and new technologies, delivering solutions with real impact. If you value professionalism, creativity, and a strong engineering culture, you'll feel at home here.

Apply for this position