> Markdown version of [/events/world-congress-2024/sessions/299-volatile-data-lakes](https://www.wearedevelopers.com/events/world-congress-2024/sessions/299-volatile-data-lakes). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Volatile data lakes in the cloud


- **Date:** Friday, Jul 19, 2024
- **Time:** 10:20–10:50 (30 min)
- **Room:** STAGE 10 (120)
- **Event:** World Congress 2024

## Description

In a world where managers want to compare multiple KPIs here and now, the ability to quickly get the right data in front of the end user is critical. However, frequent data updates cause other records to become outdated or unnecessary. Extracting interesting information from such an append-only data lake requires complex SQL queries that include windowing functions and/or join operations. As the system grows, queries become longer and longer, and time is money. This begs the question of how to cost-effectively update or delete unwanted records from the data lake to exclude them from queries. Based on my own project experience as an architect, I will show which tools in the AWS cloud can be used to answer this question. I will also share best practices for designing serverless reporting systems in the cloud.

## Speaker

### [Pawel Adaszewski](https://www.wearedevelopers.com/@pawel-adaszewski)

Senior Software Consultant @ ZEISS Digital Innovation


## Related talks at this congress

- [Building a Serverless Data Lake for Business Intelligence](https://www.wearedevelopers.com/events/world-congress-2024/sessions/318-building-a) — Alexander Günsche
- [Watch Your Wallet and Reduce Your Carbon Footprint: A Guide to Cloud Cost Optimization](https://www.wearedevelopers.com/events/world-congress-2024/sessions/58-watch-your-wallet) — Renato Losio
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/events/world-congress-2024/sessions/417-modern-data) — Matthias Niehoff
- [Databaseless Data Processing - High-Performance for Cloud-Native Apps and AI](https://www.wearedevelopers.com/events/world-congress-2024/sessions/410-databaseless-data) — Markus Kett