WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
WeAreDevelopers LIVE • Apr 18, 2023

Vectorize all the things! Using linear algebra and NumPy to make your Python code lightning fast.

Jodie Burchell

Are nested loops turning your Python scripts into multi-hour bottlenecks? Compress execution times down to mere milliseconds using NumPy and linear algebra vectorization.

Pause
Mute Enter Fullscreen
#1 about 3 min

Introduction to speeding up code with vector operations

Traditional lists and nested loops scale poorly when processing large datasets, making vectorized operations a necessary alternative.

#2 about 3 min

Understanding basic linear algebra vectors and array features

Representing physical characteristics as numerical elements allows spatial plotting in an n-dimensional vector space.

#3 about 3 min

Collecting vectors into linear algebraic matrices and structures

Grouping arrays with uniform sizes establishes practical dimensional structures for complex multi-faceted datasets.

#4 about 3 min

Calculating distance metrics for data point cluster similarities

Adding up the absolute differences between pairwise vectors provides a reliable benchmark calculation for identifying patterns.

#5 about 4 min

Implementing nearest neighbor calculations naively with nested sequences

Computing exact pairwise distances sequentially through nested loops highlights significant scalability and computational performance bottlenecks.

#6 about 3 min

Benchmarking unoptimized script executions across scalable data payloads

Evaluating list-based implementations reveals severe computation slowdowns when scaling feature dimensions and overall observation volume.

#7 about 3 min

Implementing array subtraction to process sequence elements concurrently

Exchanging individual item subtractions for comprehensive array arithmetic accelerates scripting computation directly within numpy logic.

#8 about 4 min

Resolving nested loop limitations via multidimensional array reshaping

Bypassing exponential processing times requires grouping and syncing list permutations directly across three-dimensional coordinate combinations.

#9 about 3 min

Maximizing execution memory effectively via python numpy broadcasting

Replicating matrix objects manually wastes system memory before establishing stretched coordinate evaluations through explicit broadcasting.

#10 about 3 min

Refactoring basic list variables into continuous array processes

Parsing data sequences inherently as array forms consolidates loop iterations and prevents functional calculation bottlenecks.

#11 about 4 min

Overcoming python sorting constraints with dedicated array formatting

Migrating arrays toward internal numpy quicksort utilities removes unoptimized sorting procedures inherited from default iterations.

#12 about 2 min

Identifying memory allocation delays underlying dispersed system objects

Fragmenting variables across randomized disk positions halts central processing systems through constant hardware paging requests.

#13 about 2 min

Identifying performance degradation during dynamic iteration state checks

Supporting mixed collections forces python interpreters to evaluate item types sequentially lowering functional execution speed.

#14 about 2 min

Empowering continuous dataset processing utilizing native hardware architecture

Packing restricted datatype representations into contiguous blocks provides direct alignment for rapid single-instruction parallel computing.

#15 about 23 min

Navigating developer advocacy transitions and computational logic alternatives

Community interactions explore advanced algorithm techniques like approximate nearest neighbors alongside non-traditional engineering career migration.

Matching moments

1:49 min

Accelerating script execution with CuPy and Numba kernels

Paul Graham Paul Graham · World Congress 2026 Europe

1:51 min

Accelerating math operations and kernel fusion with nvmath-python

Paul Graham Paul Graham · World Congress 2025

1:56 min

Benchmarking vectorized sorting logic against scalar baseline implementations

Laszlo Deak Laszlo Deak · Europe 2026 Virtual

36 sec

Optimizing math calculations with the vector API

Ron Veen Ron Veen · World Congress 2025

5:07 min

Leveraging specialized AI frameworks and accelerated libraries

Paul Graham Paul Graham · World Congress 2024

2:04 min

Storing and querying vector data with native database features

Damir Damir · World Congress 2025

More from WeAreDevelopers LIVE

WeAreDevelopers LIVE - Is CSS Catching Up to Flash? thumbnail
1:03:33
10 days ago

WeAreDevelopers LIVE - Is CSS Catching Up to Flash?

Chris Heilmann, Daniel Cranney, Bramus Van Damme

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along thumbnail
1:21:17
17 days ago

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along

Chris Heilmann, Daniel Cranney, Krzysztof Cieślak

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak thumbnail
4:23
19 days ago

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak

Chris Heilmann, Daniel Cranney

WeAreDevelopers LIVE - Open Source Agent Toolkits thumbnail
1:00:38
24 days ago

WeAreDevelopers LIVE - Open Source Agent Toolkits

Chris Heilmann, Daniel Cranney, Eddie Jaoude

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude thumbnail
6:16
26 days ago

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude

Chris Heilmann, Daniel Cranney

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas thumbnail
5:46
about 1 month ago

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas

Chris Heilmann, Daniel Cranney, Marc Plogas

Related videos

Accelerating Python on GPUs thumbnail
59:43
LIVE • over 2 years ago

Accelerating Python on GPUs

Paul Graham

Accelerating Python on GPUs thumbnail
22:18
World Congress 2024 • about 2 years ago

Accelerating Python on GPUs

Paul Graham

From Loops to Lightning: .NET with SIMD thumbnail
24:54
Europe 2026 Virtual • 3 months ago

From Loops to Lightning: .NET with SIMD

Laszlo Deak

Accelerating Python on GPUs thumbnail
24:39
World Congress 2025 • about 1 year ago

Accelerating Python on GPUs

Paul Graham

CUDA Python: GPU programming for the modern developer thumbnail
29:43
World Congress 2026 Europe • 3 months ago

CUDA Python: GPU programming for the modern developer

Paul Graham

CUDA in Python thumbnail
21:02
LIVE • over 1 year ago

CUDA in Python

Andy Terrel

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.