World Congress 2023 • Sep 27, 2023

Data is Key: Scraping Metadata from Websites

Lars Kölker

Tired of scrapers breaking after minor UI updates? Stop relying on brittle CSS selectors. Build resilient metadata extractors using JSON-LD and Open Graph protocols.

Data is Key: Scraping Metadata from Websites thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

5:54 min

The technical evolution of modern web scraping infrastructure

Chris Heilmann

Chris Heilmann +4 · LIVE

3:35 min

Impact of AI data scraping on open web content

Léonie Watson · A11y + AI

1:09 min

Exploring data collection challenges from user-generated platforms

Linda Mohamed · LIVE

2:27 min

Core definitions of modern web data extraction

Domagoj Marić

Domagoj Marić · Europe 2026 Virtual

2:54 min

Technical workflow for generating self-healing scrapers

Ariel Shulman

Ariel Shulman +1 · World Congress 2026 Europe

1:45 min

Concluding thoughts on scraper tools and audience questions

Alexander Lichter · World Congress 2023

More from World Congress 2023

The year 3000, a brief history of Web Development thumbnail

The year 3000, a brief history of Web Development

Lorenzo Pieri

Demografie nutzen um jedem Bewerber das passende Angebot zu machen! thumbnail

Demografie nutzen um jedem Bewerber das passende Angebot zu machen!

Nathalie Gierth

Passwordless future: WebAuthn and Passkeys in practice thumbnail

Passwordless future: WebAuthn and Passkeys in practice

Clemens Hübner · inovex

External Secrets Operator: the secrets management toolbox for self-sufficient teams thumbnail

External Secrets Operator: the secrets management toolbox for self-sufficient teams

Moritz Johner

Building Reliable Serverless Applications with AWS CDK and Testing thumbnail

Building Reliable Serverless Applications with AWS CDK and Testing

Fifty Shades of Kubernetes Autoscaling thumbnail

Fifty Shades of Kubernetes Autoscaling

Mario-Leander Reimer

Upcoming sessions on this topic

100 APIs, 1000 Headaches: Overcoming Data Transformation Challenges in API Integration

Pradeep Sharma

RudderStack

Developer Relations Specialist

Built-In AI in the Browser: Practical Capabilities for Modern Web Apps

Piyush Gupta

Expedia

Senior Engineering Manager

Data Quality Is the Hidden System That Keeps Modern Data Platforms Alive

Rakshika Prasad

Schneider Electric

Data Engineer

Your Server-Rendered App Doesn't Know Who It's Talking To

Anshul Bansal

OLX India

Principal Architect

Beyond File Dumps: Context Engineering for Coding Agents

Animesh Dutta

Arm

Senior Software Engineer

Build a Zero-Cost AI Agent in Your Browser

Aishwarya Mathuria

Adobe

Computer Scientist
Nishant Thakur

Adobe

Senior Computer Scientist

Related videos

Modern Web Data Extraction: Techniques, Tools, and Legal & Ethical Considerations thumbnail

Modern Web Data Extraction: Techniques, Tools, and Legal & Ethical Considerations

Domagoj Marić · Pontis Technology

Europe Virtual · 2026

Scrape, Train, Predict: The Lifecycle of Data for AI Applications thumbnail

Scrape, Train, Predict: The Lifecycle of Data for AI Applications

Vidas Bacevičius · Oxylabs

World Congress · 2025

From clicks to cribs - How to find your dream home with web scraping thumbnail

From clicks to cribs - How to find your dream home with web scraping

Alexander Lichter

World Congress · 2023

Cracking the Code: Decoding Anti-Bot Systems! thumbnail

Cracking the Code: Decoding Anti-Bot Systems!

Fabien Vauchelles

LIVE · May 2024

How to scrape modern websites to feed AI agents thumbnail

How to scrape modern websites to feed AI agents

Jan Curn · Apify

World Congress · 2025

Bringing Clarity to Event Streams: Enabling Analytics and AI Through Rich Metadata thumbnail

Bringing Clarity to Event Streams: Enabling Analytics and AI Through Rich Metadata

Clemens Vasters · Microsoft

World Congress · 2025

Related articles

CH

Chris Heilmann

The Web We Broke (And Why AI Agents Are Paying the Price) - AgentCon Berlin

This is the accompanying post to the talk Chris Heilmann gave at AgentCon in Berlin on 19/05/2026, you can also see the slides and listen to it in this screencast: Thirty years of developer shortc...

6 months ago

Yahoo Pipes allowing you to remix HTML content

CH

Chris Heilmann

Dev Digest 133 - Back to Front

News and ArticlesWeAreDevelopers LIVE WebDev Day is on Wednesday, 18/11/2024. Learn about Design-first APIs for UI components, the JavaScript event loop, the Secret sauce behind pattern matching an...

about 2 years ago

Dev Digest 133 - Back to Front

CH

Chris Heilmann

Dev Digest 139 - Soft and hard queries

News and ArticlesLet's start with Amelia Wattenberger's excellent essay Bridging the hard and the soft talking about humans and data. Do you sometimes also miss aspects of the early web like a lack...

about 2 years ago

Dev Digest 139 - Soft and hard queries

CH

Chris Heilmann

WebMCP: Empowering Agents as First-Class Citizens of the Web

WebMCP is an exciting W3C proposal that just landed in Chrome Canary to try out . The idea is that you can use some HTML attributes on a form or register JavaScript tool methods to give agents di...

9 months ago

WebMCP: Empowering Agents as First-Class Citizens of the Web

From learning to earning

Jobs that call for the skills explored in this talk.

5 days ago • Verified

Senior Data & AI Architect

reeeliance IM GmbH

Berlin, Germany

Expert Remote Python Microsoft SQL Server Cloud (AWS/Google/Azure)

6 days ago • Verified

Senior Software Engineer - Semantic Data Lake (Open)SDE3

Bengaluru, India

Expert Remote Scala Python Terraform

about 2 months ago • Verified

(Senior) Data Engineer

Sportradar Media Services GmbH

Vienna, Austria

Experienced €65k–72k Python Amazon Web Services…

Solutions Architect UK & Ireland

Expert £78k Node.Js Selenium Playwright

6 days ago • Verified

Director of Engineering - Data Platform SDM5

Bengaluru, India

Expert Remote ETL Spark Java EE

about 1 month ago • Verified

AI Software Engineer (Germany)

Berlin, Germany

Expert €70k–100k Remote REST TypeScript AI Frameworks