WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
WeAreDevelopers LIVE • Apr 18, 2023

Vectorize all the things! Using linear algebra and NumPy to make your Python code lightning fast.

Jodie Burchell

Are nested loops turning your Python scripts into multi-hour bottlenecks? Compress execution times down to mere milliseconds using NumPy and linear algebra vectorization.

Pause
Mute Enter Fullscreen
#1 about 3 min

Introduction to speeding up code with vector operations

Traditional lists and nested loops scale poorly when processing large datasets, making vectorized operations a necessary alternative.

#2 about 3 min

Understanding basic linear algebra vectors and array features

Representing physical characteristics as numerical elements allows spatial plotting in an n-dimensional vector space.

#3 about 3 min

Collecting vectors into linear algebraic matrices and structures

Grouping arrays with uniform sizes establishes practical dimensional structures for complex multi-faceted datasets.

#4 about 3 min

Calculating distance metrics for data point cluster similarities

Adding up the absolute differences between pairwise vectors provides a reliable benchmark calculation for identifying patterns.

#5 about 4 min

Implementing nearest neighbor calculations naively with nested sequences

Computing exact pairwise distances sequentially through nested loops highlights significant scalability and computational performance bottlenecks.

#6 about 3 min

Benchmarking unoptimized script executions across scalable data payloads

Evaluating list-based implementations reveals severe computation slowdowns when scaling feature dimensions and overall observation volume.

#7 about 3 min

Implementing array subtraction to process sequence elements concurrently

Exchanging individual item subtractions for comprehensive array arithmetic accelerates scripting computation directly within numpy logic.

#8 about 4 min

Resolving nested loop limitations via multidimensional array reshaping

Bypassing exponential processing times requires grouping and syncing list permutations directly across three-dimensional coordinate combinations.

#9 about 3 min

Maximizing execution memory effectively via python numpy broadcasting

Replicating matrix objects manually wastes system memory before establishing stretched coordinate evaluations through explicit broadcasting.

#10 about 3 min

Refactoring basic list variables into continuous array processes

Parsing data sequences inherently as array forms consolidates loop iterations and prevents functional calculation bottlenecks.

#11 about 4 min

Overcoming python sorting constraints with dedicated array formatting

Migrating arrays toward internal numpy quicksort utilities removes unoptimized sorting procedures inherited from default iterations.

#12 about 2 min

Identifying memory allocation delays underlying dispersed system objects

Fragmenting variables across randomized disk positions halts central processing systems through constant hardware paging requests.

#13 about 2 min

Identifying performance degradation during dynamic iteration state checks

Supporting mixed collections forces python interpreters to evaluate item types sequentially lowering functional execution speed.

#14 about 2 min

Empowering continuous dataset processing utilizing native hardware architecture

Packing restricted datatype representations into contiguous blocks provides direct alignment for rapid single-instruction parallel computing.

#15 about 23 min

Navigating developer advocacy transitions and computational logic alternatives

Community interactions explore advanced algorithm techniques like approximate nearest neighbors alongside non-traditional engineering career migration.

Matching moments

1:49 min

Accelerating script execution with CuPy and Numba kernels

Paul Graham Paul Graham · WWC Europe 2026

1:51 min

Accelerating math operations and kernel fusion with nvmath-python

Paul Graham Paul Graham · WWC 2025

36 sec

Optimizing math calculations with the vector API

Ron Veen Ron Veen · WWC 2025

5:07 min

Leveraging specialized AI frameworks and accelerated libraries

Paul Graham Paul Graham · WWC 2024

2:04 min

Storing and querying vector data with native database features

Damir Damir · WWC 2025

1:42 min

Extending distributed parallel processing capabilities using QNumeric arrays

Paul Graham Paul Graham · LIVE

More from WeAreDevelopers LIVE

Aliens in Quarantine, Python Deprecates Loops, and AI Buys Old Books - Zbyszek Tenerowicz thumbnail
5:43
5 days ago

Aliens in Quarantine, Python Deprecates Loops, and AI Buys Old Books - Zbyszek Tenerowicz

Chris Heilmann, Daniel Cranney

WeAreDevelopers LIVE - Node and Package Security thumbnail
1:08:30
5 days ago

WeAreDevelopers LIVE - Node and Package Security

Chris Heilmann, Daniel Cranney, Zbyszek Tenerowicz

WeAreDevelopers LIVE - Streaming HTML thumbnail
1:10:26
12 days ago

WeAreDevelopers LIVE - Streaming HTML

Chris Heilmann, Daniel Cranney, Jad Joubran

WeAreDevelopers LIVE - CODE100 at WeAreDevelopers Europe thumbnail
1:02:34
19 days ago

WeAreDevelopers LIVE - CODE100 at WeAreDevelopers Europe

Chris Heilmann, Daniel Cranney, Justin Halsall, Werner Jeschko, Nicole Jeschko, Mirco Tomić

WeAreDevelopers LIVE - Web Performance in an AI World thumbnail
1:07:59
26 days ago

WeAreDevelopers LIVE - Web Performance in an AI World

Chris Heilmann, Daniel Cranney

FIFA Hack, Midjourney Does Ultrasounds, and Trampoline Traffic Lights - Nicole Jeschko and Werner Jeschko thumbnail
5:55
about 2 months ago

FIFA Hack, Midjourney Does Ultrasounds, and Trampoline Traffic Lights - Nicole Jeschko and Werner Jeschko

Chris Heilmann, Daniel Cranney

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Fast, Cheap, and Accurate: Optimizing LLM Inference with vLLM and Quantization

Cedric Clyburn, Legare Kerrison

Cedric Clyburn
Legare Kerrison
Open session

World Congress 2026 North America

You Can’t Re-Run Sunlight: Designing ML Data Architectures for Physical AI

An Phan

Senior Data Infrastructure Engineer @ Hippo Harvest

An Phan
Open session

World Congress 2026 North America

KV Cache Is Not About Speed: It's About Surviving Inference Costs

David vonThenen

AI/ML Leader | Keynote Speaker | OSS Engineer & Developer Advocate | Agentic AI, Deep Learning, Production AI | Python, Go, C++

David vonThenen
Open session

World Congress 2026 North America

Beyond Vibe Coding: Using CLI Tools as Your AI Counterpart in Pair Programming

Ron Veen

Java enthusiast and Special agent for Team Rockstars IT

Ron Veen
Open session

World Congress 2026 North America

Compute for your AI model: GPUs, LPUs, TPUs and beyond..

Kushaagra Goyal

Tech Lead at Rubrik, ex-CTO at Gan.AI, ex-Databricks

Kushaagra Goyal
Open session

World Congress 2026 North America

How to generate business value through performance optimizations

Nikolai Sidiropulo

Software Engineer at Meta

Nikolai Sidiropulo

Related videos

Accelerating Python on GPUs thumbnail
59:43
LIVE • over 2 years ago

Accelerating Python on GPUs

Paul Graham

Accelerating Python on GPUs thumbnail
22:18
WWC 2024 • almost 2 years ago

Accelerating Python on GPUs

Paul Graham

Accelerating Python on GPUs thumbnail
24:39
WWC 2025 • 12 months ago

Accelerating Python on GPUs

Paul Graham

CUDA Python: GPU programming for the modern developer thumbnail
29:43
WWC Europe 2026 • about 1 month ago

CUDA Python: GPU programming for the modern developer

Paul Graham

CUDA in Python thumbnail
21:02
LIVE • over 1 year ago

CUDA in Python

Andy Terrel

30 Golden Rules of Deep Learning Performance thumbnail
46:30
LIVE • about 6 years ago

30 Golden Rules of Deep Learning Performance

Anirudh Koul

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.