WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
WeAreDevelopers LIVE • Jun 1, 2023

Using WebAssembly for in-database Machine Learning

Akmal Chaudhri

Tired of building expensive ETL pipelines just to run machine learning models? Learn how WebAssembly lets you execute secure, near-native ML workloads directly inside your database.

Pause
Mute Enter Fullscreen
#1 about 3 min

Introduction to WebAssembly for in-database machine learning

An overview of utilizing WebAssembly to execute machine learning modules directly within a database management system.

#2 about 2 min

Evolution of distributed SQL database management systems

How modern distributed relational databases enable horizontal scaling for analytical and operational workloads.

#3 about 3 min

Options for database machine learning integration architectures

Utilizing tools like Apache Spark, Python libraries, and vector embeddings to perform machine learning near or within databases.

#4 about 4 min

Benefits of executing WebAssembly natively in databases

How WebAssembly addresses complex procedural SQL, provides data co-location, and reduces developer effort for data science tasks.

#5 about 4 min

Architectural flow of WebAssembly inside a DBMS

The process of compiling business logic in languages like Rust or C++ and executing it within a secure database sandbox.

#6 about 3 min

Setting up the Wasm SDK and Rust toolchain

Instructions for downloading and configuring the WebAssembly SDK and Bytecode Alliance tools for local development.

#7 about 2 min

Preparing local tools to push Wasm executable modules

Cloning and building the push-wasm GitHub dependency tool to bridge compiled modules into SingleStore.

#8 about 3 min

Defining Wit interfaces and declaring Rust backend dependencies

Configuring an interface definition file to specify input and output types for a VADER sentiment algorithm.

#9 about 4 min

Compiling and uploading Rust logic into the DBMS

Creating the actual sentiment scoring function in Rust and pushing it to the database for use as a user-defined function.

#10 about 3 min

Testing sentiment inference behavior via SQL select statements

Verifying the WebAssembly function behavior on text patterns like capitalization and exclamation points directly inside standard SQL queries.

#11 about 6 min

Live demo applying sentiment analysis on an IMDB dataset

Applying the deployed Rust WebAssembly module across an IMDB review table to batch-compute machine learning scores without ETL.

#12 about 4 min

Key takeaways and developer resources for WebAssembly integration

A summary of WebAssembly extensibility capabilities along with resources from the Bytecode Alliance.

#13 about 23 min

Audience Q&A on language support, performance, and tradeoffs

A community discussion focusing on dynamic language support, native performance comparisons, testing workflows, and potential cloud provider implementations.

Matching moments

2:27 min

Introduction to WebAssembly in a cloud computing context

Edo Edo · World Congress 2024

1:48 min

Introduction to WebAssembly as a compilation target

Niels Tanis Niels Tanis · World Congress 2023

2:50 min

Expanding ecosystem adoption across WebAssembly and AI frameworks

Thomas Steiner · Coffee With Developers

3:06 min

Optimizing memory management and data processing with WebAssembly

Andrew Burnett-Thompson +1 · Coffee With Developers

2:32 min

Applying WebAssembly to serverless cloud environments

Matt Butcher · World Congress 2023

3:32 min

Redefining WebAssembly beyond browser video games

Edoardo Dusi · LIVE

More from WeAreDevelopers LIVE

WeAreDevelopers LIVE - Tech Education in Two Languages thumbnail
1:00:18
4 days ago

WeAreDevelopers LIVE - Tech Education in Two Languages

Daniel Cranney, Roxy Rodriguez-Becker

WeAreDevelopers LIVE - Playing in Production thumbnail
1:06:40
11 days ago

WeAreDevelopers LIVE - Playing in Production

Andrew MacLean, Daniel Cranney, Christian Heilmann

WeAreDevelopers LIVE - Is CSS Catching Up to Flash? thumbnail
1:03:33
25 days ago

WeAreDevelopers LIVE - Is CSS Catching Up to Flash?

Chris Heilmann, Daniel Cranney, Bramus Van Damme

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along thumbnail
1:21:17
about 1 month ago

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along

Chris Heilmann, Daniel Cranney, Krzysztof Cieślak

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak thumbnail
4:23
about 1 month ago

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak

Chris Heilmann, Daniel Cranney

WeAreDevelopers LIVE - Open Source Agent Toolkits thumbnail
1:00:38
about 1 month ago

WeAreDevelopers LIVE - Open Source Agent Toolkits

Chris Heilmann, Daniel Cranney, Eddie Jaoude

Upcoming sessions on this topic

Open session

Architecting Trusted AI: Coupling Multi-Agent Systems with dbt Semantic Store for Zero-Hallucination

  • Pushkar Mishra

    J.P. Morgan

    Senior Vice President

Open session

Build a Zero-Cost AI Agent in Your Browser

  • Aishwarya Mathuria

    Adobe

    Computer Scientist

  • Nishant Thakur

    Adobe

    Senior Computer Scientist

Open session

Beyond File Dumps: Context Engineering for Coding Agents

  • Animesh Dutta

    Arm

    Senior Software Engineer

Open session

Teaching AI Coding Agents to Build It Right the First Time

  • Sajeetharan Sinnathurai

    Microsoft

    Principal Product Manager

Open session

Java is Coming for Python’s Lunch: The Rise of JVM AI Agents

  • Frederik Pietzko

    Jetbrains

    Developer Advocate

Open session

How is SWE & EM roles are changing in the age of AI

  • Amol Sharma

    Stripe

    Engineering Manager

Related videos

Using WebAssembly to run, extend, and secure your application thumbnail
25:08
World Congress 2023 • about 3 years ago

Using WebAssembly to run, extend, and secure your application

Niels Tanis

WebAssembly: The Next Frontier of Cloud Computing thumbnail
57:32
LIVE • over 2 years ago

WebAssembly: The Next Frontier of Cloud Computing

Edoardo Dusi

WebAssembly Revolution: Elevating JavaScript's Reach and Performance thumbnail
30:57
World Congress 2024 • about 2 years ago

WebAssembly Revolution: Elevating JavaScript's Reach and Performance

Önder Ceylan

Wasm Deep Dive - A Glance Behind the Scenes thumbnail
57:45
LIVE • over 2 years ago

Wasm Deep Dive - A Glance Behind the Scenes

Rainer Stropek

WebAssembly: Disassembled thumbnail
27:27
World Congress 2023 • about 3 years ago

WebAssembly: Disassembled

Stefan Schöberl

WebAssembly: The Next Frontier of Cloud Computing thumbnail
30:58
World Congress 2024 • about 2 years ago

WebAssembly: The Next Frontier of Cloud Computing

Edo

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.