Sre - Dataplatform

Veepee
Barcelona, Spain
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Tech stack

Query Performance Java (Programming Language) Application Programming Interfaces (APIs) Airflow Amazon S3 Computer Programming Data Architecture Data Infrastructure Data Warehousing Failover Protocol Buffers Java Management Extensions
+17 more
JSON Python (Programming Language) PostgreSQL Prometheus Runbook Ceph (Software) S3 Bucket System Availability Grafana Core Data Kubernetes Infrastructure Automation Frameworks Storage Technologies Avro Apache Kafka Database Replication Terraform

Job description

Join a transversal SRE community embedded in a product-oriented Data Platform team of ***** engineers, analysts, and data scientists across France and Spain. You’ll drive the reliability and scalability of a next-generation Lakehouse platform - anchored on Trino, Iceberg, and on-prem object storage - while leading the transition from public cloud to a resilient hybrid/on-prem architecture.? TASKS Platform Reliability & SRE foundationsOwn reliability of core data services: Trino, Iceberg, S3 / Ceph, Kafka, Kafka Connect, Schema RegistryDefine and enforce SLIs/SLOs, error budgets, and on-call runbooks - solid SRE foundations are non-negotiableBuild full-stack observability with Prometheus and Grafana: metrics, dashboards, alerting pipelines, and anomaly detectionManage and harden PostgreSQL clusters via Patroni for high-availability control-plane servicesKafka ecosystem - Connect & Schema governanceOperate and scale Kafka Connect clusters: connector lifecycle, offset management, dead-letter queues, and task rebalancingMaintain the Schema Registry as the single source of truth for Avro/Protobuf/JSON schemas - enforce compatibility rules and schema evolution policiesMonitor consumer lag, connector throughput, and broker health via Prometheus JMX exporters and Grafana dashboardsEnsure end-to-end data contract integrity between producers and Iceberg/S3 consumersKubernetes, Kube-in-Kube & CrossplaneOperate production Kubernetes clusters (GKE/EKS + on-prem) - capacity planning, upgrades, PodDisruptionBudgets, resource quotasArchitect and manage Kube-in-Kube topologies to provide strong tenant isolation for data platform workloads - each team gets a dedicated virtual cluster without the overhead of a full physical clusterAutomate infrastructure and resource provisioning with Crossplane: define composite resources (XRDs) so data teams can self-serve Kafka topics, Trino namespaces, and S3 buckets through Kubernetes-native APIsMaintain GitOps pipelines for platform deployment and configuration drift detectionLakehouse architecture & cloud migrationMigrate from public cloud data warehouse to VeepeeCloud Iceberg-based lakehouse - managing coexistence, schema evolution, and time-travelArchitect resilient ingestion, transformation, and serving layers around Trino + S3Optimize Trino query performance: memory limits, spilling, cost-based optimizer tuningAgentic & developer enablementBuild agentic self-service tooling so data teams can provision Trino/Iceberg resources and Kafka Connect pipelines autonomously via Crossplane - reducing toil and ops bottlenecksDevelop FinOps dashboards (compute, storage, query cost) with Grafana and Prometheus-based cost exportersWrite clear technical documentation, runbooks, and internal ADRsMulti-DC resilience & DRPDesign and implement multi-datacenter strategies across FR1 / NL1 - active-active and active-passive topologiesLeverage Fast Erasure Coding on object storage (Ceph/S3) to maximize durability with minimal replication overheadEnsure data replication consistency across sites for Iceberg table metadata, Trino catalogs, and Schema Registry subjectsLead DRP exercises: failover playbooks, RTO/RPO validation, postmortems? MUST HAVE skills Must haveStrong experience with Kubernetes in production environmentsExperience with Kube-in-Kube technologies (vCluster or similar)Solid understanding of SRE principles (SLIs/SLOs, error budgets)Experience with Prometheus and GrafanaExperience with Infrastructure as Code (Terraform or similar)Experience with CrossplaneFamiliarity with GitOps workflowsExperience with S3 and object storage technologiesExperience with PostgreSQL and PatroniExperience with Kafka, Kafka Connect, and Schema RegistryFluent in English? NICE TO HAVE skillsExperience with multi-datacenter architectures (FR1/NL1)Experience designing disaster recovery plans and failover playbooksExperience with Fast Erasure Coding (Ceph/S3)Experience with Trino, Iceberg, and Lakehouse technologiesExperience with AirflowExperience building agentic self-service platformsKnowledge of FinOps and cost optimization practicesProgramming experience in Python, Java, or Go? BENEFITSVariable bonusE-learning platform (self-education courses)Meetups & conferences (local and international)Flexible office - up to 2 days remoteInternational teams (France & Spain)?? RECRUITMENT PROCESS1?? 30-minute HR Screen with a VeepeeTech Recruiter2?? General Technical exchange3?? Technical exchange with the manager4?? Team InterviewWe are convinced that it is up to you to define the way you work, to develop yourself and to progress.At Veepee we guarantee that you can just be yourself!For the service of diversity and inclusion, Veepee is committed to reviewing all applications received on an equal basis.?COMPANYFor more information about our ecosystem :/We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Requirements

Strong experience with Kubernetes in production environments Experience with Kube-in-Kube technologies (vCluster or similar) Solid understanding of SRE principles (SLIs/SLOs, error budgets) Experience with Prometheus and Grafana Experience with Infrastructure as Code (Terraform or similar) Experience with Crossplane Familiarity with GitOps workflows Experience with S3 and object storage technologies Experience with PostgreSQL and Patroni Experience with Kafka, Kafka Connect, and Schema Registry Fluent in English ? NICE TO HAVE skills

Experience with multi-datacenter architectures (FR1/NL1) Experience designing disaster recovery plans and failover playbooks Experience with Fast Erasure Coding (Ceph/S3) Experience with Trino, Iceberg, and Lakehouse technologies Experience with Airflow Experience building agentic self-service platforms Knowledge of FinOps and cost optimization practices Programming experience in Python, Java, or Go

Benefits & conditions

Variable bonus E-learning platform (self-education courses) Meetups & conferences (local and international) Flexible office - up to 2 days remote International teams (France & Spain) ?? RECRUITMENT PROCESS

1?? 30-minute HR Screen with a VeepeeTech Recruiter

2?? General Technical exchange

3?? Technical exchange with the manager

4?? Team Interview We are convinced that it is up to you to define the way you work, to develop yourself and to progress. At Veepee we guarantee that you can just be yourself! For the service of diversity and inclusion, Veepee is committed to reviewing all applications received on an equal basis.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.buscojobs.com.es

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

3:02 min

Audience Q&A on data formats and engine tradeoffs

Matthias Niehoff Matthias Niehoff · WWC Europe 2026

3:47 min

Exploring JSON, CBOR, and JOSE for data serialization

Aaron Russell · LIVE

1:34 min

Pivoting careers into specialized platform engineering roles

Xavier Portilla Edo · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

1:52 min

Customizing block storage tiers and formats

Ricardo Sueiras Sueiras · LIVE

Videos

See all

Related articles

See all