WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe - Virtual Stage • Jul 2, 2026 • Session details

Modern Web Data Extraction: Techniques, Tools, and Legal & Ethical Considerations

Domagoj Marić

Is your web scraper risking IP bans or lawsuits? Master strict politeness policies and modern Python tools to build resilient, legally compliant data extraction pipelines.

Modern Web Data Extraction: Techniques, Tools, and Legal & Ethical Considerations thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

5:54 min

The technical evolution of modern web scraping infrastructure

Chris Heilmann Chris Heilmann +4 · LIVE

3:35 min

Impact of AI data scraping on open web content

Léonie Watson · A11y + AI

1:19 min

Defining web scraping and recognizing proper use cases

Lars Kölker · World Congress 2023

6:20 min

Securing competitive intelligence using automated web extraction crawlers

Coffee With Developers

1:19 min

Tailoring custom web scrapers for artificial intelligence training

Vidas Bacevičius Vidas Bacevičius · World Congress 2025

2:14 min

Understanding the basic mechanics of automated web scraping

Vidas Bacevičius Vidas Bacevičius · World Congress 2025

More from World Congress 2026 Europe - Virtual Stage

One Does Not Simply Make Architecture Decisions Alone thumbnail
36:15

One Does Not Simply Make Architecture Decisions Alone

Vladas Diržys

From Black Box to Glass Box : Bedrock AgentCore Observability thumbnail
21:15

From Black Box to Glass Box : Bedrock AgentCore Observability

Yasemin Aktürk · AWS

Leading in Rhythm: How Women Make Better Decisions with Biological Intelligence thumbnail
30:41

Leading in Rhythm: How Women Make Better Decisions with Biological Intelligence

Julia Grosse · Founder and CEO

Better Together: Leveraging Your Observability Tools as a SIEM thumbnail
39:06

Better Together: Leveraging Your Observability Tools as a SIEM

Mathias Palmersheim · VictoriaMetrics

ChatGPT Apps: From Chat to Checkout thumbnail
30:29

ChatGPT Apps: From Chat to Checkout

Aaron Koivunen · tedix.dev

Interior Decorating (TypeScript Decorators) thumbnail
29:22

Interior Decorating (TypeScript Decorators)

Michael Dowden · Andromeda Galactic Solutions

Upcoming sessions on this topic

Open session

Built-In AI in the Browser: Practical Capabilities for Modern Web Apps

  • Piyush Gupta

    Expedia

    Senior Engineering Manager

Open session

Build a Zero-Cost AI Agent in Your Browser

  • Aishwarya Mathuria

    Adobe

    Computer Scientist

  • Nishant Thakur

    Adobe

    Senior Computer Scientist

Open session

Engineering AI Strategy: Beyond the Hype

  • Omkar Srivastava

    ADSK

    Engineering Leader

Open session

Beyond File Dumps: Context Engineering for Coding Agents

  • Animesh Dutta

    Arm

    Senior Software Engineer

Open session

The Illusion of Green: Why AI-Generated Browser Automation Tests Pass Locally but Fail in CI

  • Puja Jagani

    BrowserStack

    Lead of Open Source and Developer Advocacy

Open session

Teaching AI Coding Agents to Build It Right the First Time

  • Sajeetharan Sinnathurai

    Microsoft

    Principal Product Manager

Related videos

Scrape, Train, Predict: The Lifecycle of Data for AI Applications thumbnail
26:15

Scrape, Train, Predict: The Lifecycle of Data for AI Applications

Vidas Bacevičius · Oxylabs

World Congress · 2025

Data is Key: Scraping Metadata from Websites thumbnail
21:17

Data is Key: Scraping Metadata from Websites

Lars Kölker

World Congress · 2023

How to scrape modern websites to feed AI agents thumbnail
19:20

How to scrape modern websites to feed AI agents

Jan Curn · Apify

World Congress · 2025

Cracking the Code: Decoding Anti-Bot Systems! thumbnail
57:47

Cracking the Code: Decoding Anti-Bot Systems!

Fabien Vauchelles

LIVE · May 2024

From clicks to cribs - How to find your dream home with web scraping thumbnail
26:08

From clicks to cribs - How to find your dream home with web scraping

Alexander Lichter

World Congress · 2023

Command the Bots: Mastering robots.txt for Generative AI and Search Marketing thumbnail
30:47

Command the Bots: Mastering robots.txt for Generative AI and Search Marketing

Fili Wiese · Search Brothers

2024

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.