Dubravko Dolic & Hüdaverdi Cakir
Industrializing your Data Science capabilities
#1about 2 minutes
The challenge of industrializing data science models
A tire recall incident highlights the gap between a data scientist's local Python script and a scalable, production-ready solution.
#2about 3 minutes
Building the initial concept for a data science factory
The journey began with a demand forecasting use case, leading to the concept of a lab for experimentation and a factory for industrialization.
#3about 5 minutes
Establishing processes and a cloud-agnostic tool stack
A standardized process with dev, QA, and prod stages was created, supported by a cloud-agnostic tool stack including Git, Jenkins, and Kubernetes.
#4about 5 minutes
Technical architecture for a multi-stage deployment environment
The architecture uses Kubernetes and containerization to create reproducible dev, QA, and prod environments with immutable builds and stage-specific configurations.
#5about 11 minutes
Live demo of deploying and promoting application versions
A command-line interface is used to deploy a new version of a Shiny application to the dev environment and promote an existing build from dev to QA.
#6about 5 minutes
Monitoring applications with logs and metrics
The platform provides developers with access to Elastic Stack for log aggregation and Prometheus with Grafana for metrics to monitor application performance.
#7about 2 minutes
Providing a simplified lab environment for data scientists
A web-based frontend offers pre-configured templates for RStudio and Python, abstracting away infrastructure complexity for data scientists.
#8about 4 minutes
Real-world use cases from tire manufacturing
Several applications are showcased, including real-time tire monitoring for mining trucks, optimizing material mixing, and deploying scrap prediction models to edge devices.
#9about 6 minutes
Integrating the factory into a larger analytics ecosystem
The Data Science Factory is part of a broader ecosystem that includes a telemetry backbone, image recognition pipelines, and predictive maintenance platforms.
Related jobs
Jobs that call for the skills explored in this talk.
Team Lead DevOps (m/w/d)
Rhein-Main-Verkehrsverbund Servicegesellschaft mbH
Frankfurt am Main, Germany
Senior
Matching moments
18:10 MIN
Managing massive data scales with the Robotic Drive platform
How to develop an autonomous car end-to-end: Robotic Drive and the mobility revolution
00:18 MIN
From research concepts to production-ready data products
Implementing continuous delivery in a data processing pipeline
12:06 MIN
A platform for self-service infrastructure and environments
Let developers develop again
04:43 MIN
Core concepts of continuous delivery for data
Implementing continuous delivery in a data processing pipeline
39:32 MIN
Implementing a CI/CD pipeline for your NLP model
Multilingual NLP pipeline up and running from scratch
29:33 MIN
Applying software engineering discipline to AI development
Navigating the AI Revolution in Software Development
02:48 MIN
Merging data engineering and DevOps for scalability
Software Engineering Social Connection: Yubo’s lean approach to scaling an 80M-user infrastructure
17:33 MIN
Bridging gaps with DevOps and containerization
From Punch Cards to AI-assisted Development
Featured Partners
Related Videos
DevOps for Machine Learning
Hauke Brammer
Empowering Retail Through Applied Machine Learning
Christoph Fassbach & Daniel Rohr
AI beyond the code: Master your organisational AI implementation.
Marin Niehues
From Factory Floor to Kubernetes Core: Building an Edge Platform One Step at a Time
Dean Oren & Stefan Belsch
DataForce Studio
Iryna Kondrashchenko & Oleh Kostromin
Big Business, Big Barriers? Stress-Testing AI Initiatives.
Marin Niehues
Empowering Thousands of Developers: Our Journey to an Internal Developer Platform
Bastian Heilemann & Bruno Margula
Developer Experience, Platform Engineering and AI powered Apps
Ignacio Riesgo & Natale Vinto
From learning to earning
Jobs that call for the skills explored in this talk.

DevOps Engineer – Kubernetes & Cloud (m/w/d)
epostbox epb GmbH
Berlin, Germany
Intermediate
Senior
DevOps
Kubernetes
Cloud (AWS/Google/Azure)



Senior DevOps Engineer (f/m/x)
Douglas GmbH
Düsseldorf, Germany
Senior
Kubernetes
Cloud (AWS/Google/Azure)

Team Lead and Senior Software Engineer with focus on AI
Dynatrace
Linz, Austria
Senior
Java
Team Leadership

Senior Systems/DevOps Developer (f/m/d)
Bonial International GmbH
Berlin, Germany
Senior
Python
Terraform
Kubernetes
Elasticsearch
Amazon Web Services (AWS)

Full Stack Engineer
Climax.eco
Rotterdam, Netherlands
€70-100K
Senior
TypeScript
PostgreSQL
Cloud (AWS/Google/Azure)


Cloud Engineer (m/w/d)
fulfillmenttools
Köln, Germany
€50-65K
Intermediate
TypeScript
Google Cloud Platform
Continuous Integration