Senior AI Platform Engineer

eMFusion Global
Berlin, Germany
23 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Airflow Amazon Web Services Audit Trail Software as a Service Encodings Computer Networks Extract Transform Load (ETL) Identity and Access Management Key Management Routing Nginx OAuth
+30 more
OpenID Role-Based Access Control Prometheus Runbook Data Streaming Tripwire Management of Software Versions WebSocket AI Infrastructure Datadog Policy as Code Data Ingestion Istio Large Language Models Grafana Database Optimization Caching Amazon Virtual Private Cloud (VPC) AI Platforms Kubernetes Linkerd (Service Mesh) Machine Learning Operations Terraform Stream Processing New Relic (SaaS) Software Version Control Data Pipelines Static Application Security Testing Vulnerability Analysis Dynamic Application Security Testing

Job description

  • Design and evolve a multi-tenant SaaS architecture with tenant isolation, per-tenant controls, and enterprise security
  • Build automated tenant provisioning, safe rollouts (canary/feature flags), and noisy-neighbor protection
  • Operationalise LLMs end-to-end - fine-tuning, evaluation, high-performance serving, monitoring, and embeddings workflows
  • Drive MLOps foundations: automated training pipelines, experiment tracking, and scalable model deployment
  • Manage Kubernetes clusters, GPU-heavy workloads, and autoscaling on AWS
  • Build unified CI/CD pipelines shipping ML and application code seamlessly
  • Implement comprehensive observability: logs, metrics, traces, model/data drift detection
  • Embed enterprise security and compliance - IAM, RBAC, VPC design, secrets management, encryption - at every layer
  • Design well-architected ETL/ELT pipelines, streaming systems, feature store integration, and workflow orchestration, * Deep Kubernetes: cluster ops, HPA/VPA, node pools, GPU scheduling, Karpenter, PDBs, network policies, multi-AZ design
  • Service mesh (Istio/Linkerd), ingress patterns (ALB/Nginx), secure egress, mTLS
  • Infrastructure as Code beyond basics: Terraform modules, Terragrunt, policy-as-code (OPA/Conftest), secrets automation
  • GitOps (ArgoCD/Flux), progressive delivery (Argo Rollouts/Flagger), feature flags, canary and blue/green deployments

MLOps & Model Lifecycle

  • Model lifecycle tooling: MLflow/W&B, model registry, experiment tracking, reproducible training, dataset versioning (DVC/lakeFS)
  • Pipeline orchestration: Airflow, Prefect, or Dagster + artifact stores
  • Model serving: KServe, Seldon, BentoML, or Ray Serve - online, async/batch inference, autoscaling, rollback

LLMOps

  • Prompt and version management, offline + online evaluation harnesses, RAG evaluation (retrieval metrics, groundedness), guardrails, red-teaming basics
  • Streaming inference (SSE/WebSockets), caching, routing, fallback models
  • Vector DB experience: pgvector, Pinecone, Weaviate, or Milvus - embedding lifecycle, backfills, re-embedding, indexing strategies

Observability & Security

  • OpenTelemetry, tracing, SLOs - Prometheus/Grafana, Loki/ELK, Datadog/New Relic
  • Incident management: postmortems, runbooks, error budgets
  • GDPR, encryption at rest/in transit, secrets management (AWS Secrets Manager/Vault), KMS, key rotation
  • SOC 2 / ISO 27001 familiarity, vulnerability scanning (Trivy/Grype), SBOMs, SAST/DAST

Requirements

  • Proven patterns for tenant isolation (DB-per-tenant, schema-per-tenant, row-level security), tenant-aware caching, noisy-neighbor protection
  • OIDC/OAuth2, tenant-aware RBAC/ABAC, SCIM provisioning, and audit logging for B2B SaaS, * You have shipped and operated customer-facing SaaS products at scale with real users
  • You have owned end-to-end ML/AI infrastructure - from data ingestion through to production monitoring
  • You enable engineers and data scientists to move faster through self-service platforms and automated workflows
  • You have a track record of designing systems that scale globally across regions and traffic patterns
  • You are comfortable with incident response, on-call rotations, and stabilising critical production systems
  • You think with a product mindset - customer value, reliability, and speed-to-market over technology for its own sake
  • You have a strong bias for automation and eliminating manual operational toil
  • Excellent communication skills - async collaboration, documentation, and explaining technical decisions to non-technical audiences

Benefits & conditions

  • Genuine greenfield platform engineering ownership - build it from scratch
  • Startup atmosphere with flat hierarchies within a globally established firm
  • Hybrid working, international mobility across a wide office network
  • Extensive learning and development programmes
  • Competitive package including bonus

About the company

We are working with a leading international consultancy that is building scalable, production-grade AI SaaS products within their dedicated AI Lab. This is a greenfield opportunity - you will combine deep technical expertise with strategic vision to design and build AI-powered platforms that transform enterprise clients’ business models.

The AI Lab is developing cutting-edge, large-scale AI products delivering sustained commercial impact. The team operates with a startup mindset: agile, flat hierarchies, and a genuine bias for experimentation and ownership.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.de

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:53 min

Configuring dynamic proxy updates with Istio Pilot

Jan Mensch Jan Mensch · WWC Europe 2026

2:49 min

Adopting OAuth best practices and removing outdated grants

Alexander Schwartz Alexander Schwartz · WWC Europe 2026

7:28 min

Constructing a new Docker layer from scratch

Oliver Seitz Oliver Seitz · WWC Europe 2026

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

7:15 min

Installing Istio programmatically with bash scripts

Thomas Südbröcker · LIVE

3:45 min

Fusing developer experience and platform engineering for agentic SDLC

Julia Kordick Julia Kordick · WWC Europe 2026

Videos

See all

Related articles

See all