WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
WeAreDevelopers LIVE • Jun 1, 2023

Using WebAssembly for in-database Machine Learning

Akmal Chaudhri

Tired of building expensive ETL pipelines just to run machine learning models? Learn how WebAssembly lets you execute secure, near-native ML workloads directly inside your database.

Pause
Mute Enter Fullscreen
#1 about 3 min

Introduction to WebAssembly for in-database machine learning

An overview of utilizing WebAssembly to execute machine learning modules directly within a database management system.

#2 about 2 min

Evolution of distributed SQL database management systems

How modern distributed relational databases enable horizontal scaling for analytical and operational workloads.

#3 about 3 min

Options for database machine learning integration architectures

Utilizing tools like Apache Spark, Python libraries, and vector embeddings to perform machine learning near or within databases.

#4 about 4 min

Benefits of executing WebAssembly natively in databases

How WebAssembly addresses complex procedural SQL, provides data co-location, and reduces developer effort for data science tasks.

#5 about 4 min

Architectural flow of WebAssembly inside a DBMS

The process of compiling business logic in languages like Rust or C++ and executing it within a secure database sandbox.

#6 about 3 min

Setting up the Wasm SDK and Rust toolchain

Instructions for downloading and configuring the WebAssembly SDK and Bytecode Alliance tools for local development.

#7 about 2 min

Preparing local tools to push Wasm executable modules

Cloning and building the push-wasm GitHub dependency tool to bridge compiled modules into SingleStore.

#8 about 3 min

Defining Wit interfaces and declaring Rust backend dependencies

Configuring an interface definition file to specify input and output types for a VADER sentiment algorithm.

#9 about 4 min

Compiling and uploading Rust logic into the DBMS

Creating the actual sentiment scoring function in Rust and pushing it to the database for use as a user-defined function.

#10 about 3 min

Testing sentiment inference behavior via SQL select statements

Verifying the WebAssembly function behavior on text patterns like capitalization and exclamation points directly inside standard SQL queries.

#11 about 6 min

Live demo applying sentiment analysis on an IMDB dataset

Applying the deployed Rust WebAssembly module across an IMDB review table to batch-compute machine learning scores without ETL.

#12 about 4 min

Key takeaways and developer resources for WebAssembly integration

A summary of WebAssembly extensibility capabilities along with resources from the Bytecode Alliance.

#13 about 23 min

Audience Q&A on language support, performance, and tradeoffs

A community discussion focusing on dynamic language support, native performance comparisons, testing workflows, and potential cloud provider implementations.

Matching moments

2:27 min

Introduction to WebAssembly in a cloud computing context

Edo Edo · World Congress 2024

1:48 min

Introduction to WebAssembly as a compilation target

Niels Tanis Niels Tanis · World Congress 2023

2:50 min

Expanding ecosystem adoption across WebAssembly and AI frameworks

Thomas Steiner · Coffee With Developers

2:32 min

Applying WebAssembly to serverless cloud environments

Matt Butcher · World Congress 2023

3:32 min

Redefining WebAssembly beyond browser video games

Edoardo Dusi · LIVE

1:23 min

Early implementations of WebAssembly across major industries

Niels Tanis Niels Tanis · World Congress 2023

More from WeAreDevelopers LIVE

WeAreDevelopers LIVE - Is CSS Catching Up to Flash? thumbnail
1:03:33
9 days ago

WeAreDevelopers LIVE - Is CSS Catching Up to Flash?

Chris Heilmann, Daniel Cranney, Bramus Van Damme

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along thumbnail
1:21:17
17 days ago

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along

Chris Heilmann, Daniel Cranney, Krzysztof Cieślak

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak thumbnail
4:23
18 days ago

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak

Chris Heilmann, Daniel Cranney

WeAreDevelopers LIVE - Open Source Agent Toolkits thumbnail
1:00:38
23 days ago

WeAreDevelopers LIVE - Open Source Agent Toolkits

Chris Heilmann, Daniel Cranney, Eddie Jaoude

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude thumbnail
6:16
25 days ago

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude

Chris Heilmann, Daniel Cranney

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas thumbnail
5:46
30 days ago

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas

Chris Heilmann, Daniel Cranney, Marc Plogas

Related videos

Using WebAssembly to run, extend, and secure your application thumbnail
25:08
World Congress 2023 • about 3 years ago

Using WebAssembly to run, extend, and secure your application

Niels Tanis

WebAssembly: The Next Frontier of Cloud Computing thumbnail
57:32
LIVE • over 2 years ago

WebAssembly: The Next Frontier of Cloud Computing

Edoardo Dusi

WebAssembly Revolution: Elevating JavaScript's Reach and Performance thumbnail
30:57
World Congress 2024 • about 2 years ago

WebAssembly Revolution: Elevating JavaScript's Reach and Performance

Önder Ceylan

Wasm Deep Dive - A Glance Behind the Scenes thumbnail
57:45
LIVE • over 2 years ago

Wasm Deep Dive - A Glance Behind the Scenes

Rainer Stropek

WebAssembly: Disassembled thumbnail
27:27
World Congress 2023 • about 3 years ago

WebAssembly: Disassembled

Stefan Schöberl

WebAssembly: The Next Frontier of Cloud Computing thumbnail
30:58
World Congress 2024 • about 2 years ago

WebAssembly: The Next Frontier of Cloud Computing

Edo

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.