WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
WeAreDevelopers LIVE • Jun 17, 2020

30 Golden Rules of Deep Learning Performance

Anirudh Koul

Stop buying more compute power to fix GPU starvation. Discover how serializing datasets, shifting augmentation, and using mixed precision can exponentially accelerate your deep learning pipelines.

Pause
Mute Enter Fullscreen
#1 about 7 min

Identifying major training inefficiencies in machine learning processes

Waiting for large neural networks to finish training results in wasted engineering cycles and excessive infrastructure costs.

#2 about 3 min

Speeding up model training cycles with transfer learning techniques

Reusing pre-trained convolutional neural weights directly avoids initializing large multi-layer tasks from computational scratch.

#3 about 5 min

Diagnosing training performance bottlenecks with visual profiling tools

Identifying CPU-starved graphic processors is possible using native tensorboard interfaces and terminal device queries.

#4 about 4 min

Optimizing custom dataset preparation to avoid file reading latency

Serializing custom input datasets into chunked file structures naturally prevents I/O choking while reading network files.

#5 about 5 min

Building asynchronous data pipelines with TensorFlow data APIs

Interleaving batch fetching inside background threads ensures the active GPU is constantly being fed data arrays.

#6 about 3 min

Offloading complex image pre-processing and augmentations to GPUs

Porting image manipulation procedures away from main application threads explicitly removes primary CPU processing overheads.

#7 about 5 min

Maximizing GPU utilization via ideal batch sizes and mixed precision

Adopting minimum size variables alongside properly aligned layer multiples enables aggressive tensor core processing yields.

#8 about 2 min

Finding the optimal learning rate automatically to simplify tuning

Running cyclic learning algorithms across isolated experimental trials algorithmically narrows the range of potential validation metrics.

#9 about 2 min

Boosting small loop logic performance by compiling execution graphs

Decorating standard Python callbacks internally compiles backend graphs instead of explicitly interpreting local environment sequences.

#10 about 3 min

Accelerating slow convergence loops using progressive image resizing techniques

Scaling up training complexities gradually through varying image resolutions reduces early step training spans massively.

#11 about 2 min

Leveraging specialized software environments optimized for local hardware specs

Routing default open source dependencies through optimized vendor streams yields instant processor vectorized performance benefits.

#12 about 6 min

Distributing local models across cloud environments and multi-GPU frameworks

Pushing batch workloads to cloud virtual machines drastically offsets expensive single node upfront hardware architectures.

#13 about 3 min

Choosing compact predefined neural network architectures for production environments

Committing to benchmarked open source models prevents memory overflow crashes on severely limited end user devices.

#14 about 1 min

Shrinking compiled models using integer quantization for inference edges

Downgrading compiled float networks to minimal integer values significantly shrinks deployment sizes without major capability drops.

#15 about 2 min

Consolidating software strategies and reviewing deep learning performance resources

Reviewing optimization codes provides developers a comprehensive single sheet integration pipeline for immediate model scale factors.

Matching moments

46 sec

Key lessons for large-scale machine learning performance

Magne Johansen Magne Johansen · Europe 2026 Virtual

1:44 min

Strategies for scaling AI workloads across multiple GPUs

Lerna Ekmekcioglu Lerna Ekmekcioglu · Europe 2026 Virtual

4:58 min

Training neural networks and switching hardware inside notebooks

Qiyang Duan · LIVE

2:00 min

Cost and power economics of hardware acceleration

Ankit Patel Ankit Patel · World Congress 2024

1:49 min

Transformers and highly scalable parallel processing

Kamen Petroff Kamen Petroff · World Congress 2026 Europe

2:47 min

Performance benchmarks and Android developer adoption

Gian Marco Iodice Gian Marco Iodice · World Congress 2025

More from WeAreDevelopers LIVE

WeAreDevelopers LIVE - Is CSS Catching Up to Flash? thumbnail
1:03:33
10 days ago

WeAreDevelopers LIVE - Is CSS Catching Up to Flash?

Chris Heilmann, Daniel Cranney, Bramus Van Damme

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along thumbnail
1:21:17
17 days ago

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along

Chris Heilmann, Daniel Cranney, Krzysztof Cieślak

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak thumbnail
4:23
18 days ago

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak

Chris Heilmann, Daniel Cranney

WeAreDevelopers LIVE - Open Source Agent Toolkits thumbnail
1:00:38
24 days ago

WeAreDevelopers LIVE - Open Source Agent Toolkits

Chris Heilmann, Daniel Cranney, Eddie Jaoude

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude thumbnail
6:16
25 days ago

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude

Chris Heilmann, Daniel Cranney

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas thumbnail
5:46
about 1 month ago

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas

Chris Heilmann, Daniel Cranney, Marc Plogas

Related videos

Accelerating Python on GPUs thumbnail
59:43
LIVE • over 2 years ago

Accelerating Python on GPUs

Paul Graham

Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated thumbnail
30:40
World Congress 2026 Europe • 3 months ago

Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated

Christin Pohl

Trends, Challenges and Best Practices for AI at the Edge thumbnail
29:50
World Congress 2023 • about 3 years ago

Trends, Challenges and Best Practices for AI at the Edge

Ekaterina Sirazitdinova

The Gashlycrumb Tinies of AI Networking You Must Know (or Languish!) thumbnail
28:19
Europe 2026 Virtual • 3 months ago

The Gashlycrumb Tinies of AI Networking You Must Know (or Languish!)

Lerna Ekmekcioglu

Accelerating Python on GPUs thumbnail
22:18
World Congress 2024 • about 2 years ago

Accelerating Python on GPUs

Paul Graham

Efficient deployment and inference of GPU-accelerated LLMs​ thumbnail
23:01
World Congress 2024 • about 2 years ago

Efficient deployment and inference of GPU-accelerated LLMs​

Adolf Hohl

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.