WeAreDevelopers LIVE • Nov 30, 2020

Hate organising your photos? Try it with 5 Terabytes

Arto Liukkonen

How do you store and index 5TB of RAW photos without blowing your cloud budget? Discover a hybrid Raspberry Pi and AWS architecture costing under $15 a month.

Pause

Mute

Enter Fullscreen

#1 about 4 min

Managing massive volumes of raw digital camera photography

A massive collection of raw photography files creates a need for an accessible and scalable backup solution.

#2 about 4 min

Evaluating commercial cloud storage costs for large archives

Comparing commercial storage options reveals that standard tiers are too expensive for multi-terabyte archives.

#3 about 5 min

Utilizing deep archive storage for affordable digital backups

Archiving raw files in deep storage provides incredibly cheap capacity with acceptable retrieval delays.

#4 about 3 min

Extracting preview images and metadata from raw files

Generating smaller thumbnails and copying metadata enables a browsing interface without fetching massive raw files.

#5 about 4 min

Using a local hardware device for image processing

A local script handles image resizing and synchronization to avoid native binary issues in serverless functions.

#6 about 4 min

Implementing automated object and face recognition for images

Integrating artificial intelligence services allows automatic categorization of occurrences and specific individuals across thousands of photos.

#7 about 3 min

Handling service rate limits and cloud execution costs

Throttling upload speeds prevents errors from strict quotas while free tiers help mitigate processing expenses.

#8 about 4 min

Demonstrating the final architecture and web interface workflow

Connecting local processing to cloud services powers a secure web application for browsing tagged photography galleries.

#9 about 2 min

Integrating the backup gallery with a portfolio website

Tagged image metadata automatically populates a public portfolio site using cloud storage triggers and serverless functions.

#10 about 2 min

Summarizing the total monthly cost of the serverless architecture

A combination of deep archiving and serverless compute reduces massive data storage expenses to mere dollars a month.

Matching moments

4:38 min

Architecting common use cases via serverless design

Oliver Arafat · LIVE

3:35 min

Integrating cloud capabilities in a hybrid architecture

Jens Happe

Jens Happe · LIVE

5:08 min

Automating data collection and managing crowdsourced training image sets

Kris Howard · LIVE

3:29 min

Optimizing software architectures to minimize infrastructure resource drain

Hendrik Lösch

Hendrik Lösch · World Congress 2024

2:11 min

Integrating advanced cloud functionality into on-premise applications

Adam Bien · World Congress 2021

3:58 min

Struggling with ungoverned data lakes and massive storage costs

Kateřina Ščavnická

Kateřina Ščavnická · World Congress 2025

More from WeAreDevelopers LIVE

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude thumbnail

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude

Chris Heilmann, Daniel Cranney

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas thumbnail

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas

Chris Heilmann, Daniel Cranney, Marc Plogas

WeAreDevelopers - Of Agents and Robots thumbnail

WeAreDevelopers - Of Agents and Robots

Chris Heilmann, Daniel Cranney, Marc Plogas

WeAreDevelopers LIVE - How DevRel Makes Tech More Human thumbnail

WeAreDevelopers LIVE - How DevRel Makes Tech More Human

Chris Heilmann, Daniel Cranney

Fake or News: Smart Glasses in Court, Medical Advice Watches & Mushroom Electonics - Jason Torres thumbnail

Fake or News: Smart Glasses in Court, Medical Advice Watches & Mushroom Electonics - Jason Torres

Chris Heilmann, Daniel Cranney

Aliens in Quarantine, Python Deprecates Loops, and AI Buys Old Books - Zbyszek Tenerowicz thumbnail

Aliens in Quarantine, Python Deprecates Loops, and AI Buys Old Books - Zbyszek Tenerowicz

Chris Heilmann, Daniel Cranney

Upcoming sessions on this topic

World Congress 2026 North America

September 25, 2026 · 14:50–15:20

Stage 2

Point. Ask. Answer. Building Vision into AI Live on Stage.

Kavya Sri Chennoju

Staff AI Engineer at Arm

Kavya Sri Chennoju

World Congress 2026 North America

September 25, 2026 · 11:40–12:10

Stage 9

You Can’t Re-Run Sunlight: Designing ML Data Architectures for Physical AI

An Phan

Senior Data Infrastructure Engineer @ Hippo Harvest

An Phan

World Congress 2026 North America

September 25, 2026 · 14:50–15:20

Stage 7

The $0.15/month Algo-Trader: Architecting High-Performance Serverless Trading Engines

Vishwak Thatikonda

Lead Full Stack Engineer at SDH Systems

Vishwak Thatikonda

World Congress 2026 North America

September 24, 2026 · 11:00–11:30

Stage 1

Application-Defined Compute: Rethinking Infrastructure for AI Applications

Anurag Goel

Founder and CEO of Render

Anurag Goel

World Congress 2026 North America

September 25, 2026 · 16:00–16:10

Outdoor Stage

public void saveMoney(AI): The Developer's Guide to Unit Economics

Hrushikesh Pokala

Senior Software Engineer Lead at Equifax

Hrushikesh Pokala

World Congress 2026 North America

September 25, 2026 · 16:10–16:40

Stage 4

Speed up your CI/CD pipelines by caching build & runtime artifacts

Thijs Feryn

Technical Evangelist at Varnish Software

Thijs Feryn

Related videos

How we built an AI-powered code reviewer in 80 hours thumbnail

World Congress 2025 • about 1 year ago

How we built an AI-powered code reviewer in 80 hours

Yan Cui

Reliable scalability: How Amazon.com scales on AWS thumbnail

World Congress 2024 • about 2 years ago

Reliable scalability: How Amazon.com scales on AWS

Florian Mair

Protector Of The Realm thumbnail

LIVE • about 3 years ago

Protector Of The Realm

Sani Yusuf

Machine Learning for Software Developers (and Knitters) thumbnail

LIVE • over 5 years ago

Machine Learning for Software Developers (and Knitters)

Kris Howard

Functions Triggers using Azure Event Grids in Azure Blob Storage thumbnail

LIVE • almost 6 years ago

Functions Triggers using Azure Event Grids in Azure Blob Storage

Menaka Baskerpillai

Leverage Cloud Computing Benefits with Serverless Multi-Cloud ML thumbnail

LIVE • almost 6 years ago

Leverage Cloud Computing Benefits with Serverless Multi-Cloud ML

Linda Mohamed

Related articles

Quick trick: working with mobile phone data in images to create thumbnails and add meta information

When you take photos with a digital camera or a mobile phone these devices add a lot of meta information directly to the file.This exif data in JPG and TIFF files can be a privacy issue, which I po...

almost 2 years ago

Quick trick: working with mobile phone data in images to create thumbnails and add meta information

CH

Chris Heilmann

Dev Digest 121 - AI goes offline

Hello fellow developer, let's take a look at the cost of AI and its efficiency, catch up on security issues and sing the praise of new JavaScript and CSS features.News and ArticlesThe way we use AI...

over 2 years ago

Dev Digest 121 - AI goes offline

CH

Chris Heilmann

Dev Digest 120 - Apple and peers

Hello fellow developer, yes, yes, yes, Apple announced a ton of things last week, so much so that you can't escape the announcements, which is why we won't cover them here. Instead, here are some i...

about 2 years ago

Dev Digest 120 - Apple and peers

CH

Chris Heilmann

Dev Digest 132 - Binging WADFlix?

Hello there, watch all the talks of the WeAreDeveloper World Congress, learn prompt engineering and how to sensibly add AI to your apps.Phase 2 of the WeAreDevelopers Cinematic UniverseToday we are...

almost 2 years ago

Dev Digest 132 - Binging WADFlix?

From learning to earning

Jobs that call for the skills explored in this talk.

5 days ago • Verified

Principal Software Engineer, AI Tools and Security

San Francisco, United States

Expert Remote Go Cloud (AWS/Google/Azure)

5 days ago • Verified

Principal Backend Engineer, Hub

Expert Remote Go Kubernetes Cloud (AWS/Google/Azure)

Software Developer - Physical & Edge AI Platforms

Seattle, WA, United States

$209k–282k U-Boot Visual Systems Cloud Services

5 days ago • Verified

Senior Software Engineer, Billing

Seattle, United States

Expert Remote Terraform Kubernetes Amazon Web Services…

15 days ago • Verified

Senior AI Serving Engineer, Backend

San Francisco, United States

Expert €190k–250k Rust Python

1 day ago • Verified

Principal Forward Deployed Engineer, Performance

Austin, United States

Experienced €207k–281k Azure Kubernetes Google Cloud Platform