How to scrape modern websites to feed AI agents
-
Jan Curn
Apify
Founder and CEO
Behind every AI breakthrough lies a critical dependency: fresh, high-quality web data. This session explores the symbiotic relationship between web scraping and artificial intelligence that’s transforming how developers build data-driven applications. Discover how machine learning is solving web scraping’s biggest challenges - from bypassing sophisticated anti-bot measures with ML-powered response recognition to building adaptive parsers that automatically handle website structure changes. We’ll explore practical use cases: training AI models with scraped data, powering real-time generation systems, and building resilient data pipelines that don’t break when websites update. You’ll learn how AI transforms web scraping from a maintenance nightmare into a strategic advantage, whether you’re building recommendation engines, training custom models, or creating intelligent data collection systems.
World Congress 2025
Jan Curn
Apify
Founder and CEO
Mehdi
Polestar
Lead Cloud Engineer
Lavinia Ghita
NVIDIA
Solution Architect
Ziv Ilan
NVIDIA
Solution Architect GenAI
Eduard
Finanz Informatik
Data Engineer Data Analytics Platform
Jannis Eickenroth
Finanz Informatik
Head of Analytics and Customer Engagement
Sophie Kleinke
Finanz Informatik
Data Engineer