WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2023 • Oct 6, 2023

From clicks to cribs - How to find your dream home with web scraping

Alexander Lichter

Automate your competitive apartment search with a custom web scraper. Learn to bypass CAPTCHAs with Puppeteer and send instant property alerts straight to a Telegram bot.

Starting at 24:22 · Watch from the beginning

From clicks to cribs - How to find your dream home with web scraping thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

5:54 min

The technical evolution of modern web scraping infrastructure

Chris Heilmann Chris Heilmann +4 · LIVE

2:54 min

Technical workflow for generating self-healing scrapers

Ariel Shulman Ariel Shulman +1 · World Congress 2026 Europe

3:09 min

Adapting scraping tools using headless browser setups

Fabien Vauchelles · LIVE

3:43 min

Scaling web scraping infrastructure to bypass strict security restrictions

Tim Ruscica · Coffee With Developers

3:40 min

Overcoming modern anti-bot mechanisms and network access restrictions

Vidas Bacevičius Vidas Bacevičius · World Congress 2025

2:20 min

Handling http network errors and anti-scraping challenges

Domagoj Marić Domagoj Marić · Europe 2026 Virtual

More from World Congress 2023

The year 3000, a brief history of Web Development thumbnail
25:30

The year 3000, a brief history of Web Development

Lorenzo Pieri

Demografie nutzen um jedem Bewerber das passende Angebot zu machen! thumbnail
8:52

Demografie nutzen um jedem Bewerber das passende Angebot zu machen!

Nathalie Gierth

Passwordless future: WebAuthn and Passkeys in practice thumbnail
32:32

Passwordless future: WebAuthn and Passkeys in practice

Clemens Hübner · inovex

External Secrets Operator: the secrets management toolbox for self-sufficient teams thumbnail
30:07

External Secrets Operator: the secrets management toolbox for self-sufficient teams

Moritz Johner

Building Reliable Serverless Applications with AWS CDK and Testing thumbnail
25:18

Building Reliable Serverless Applications with AWS CDK and Testing

Raphael Manke

Fifty Shades of Kubernetes Autoscaling thumbnail
30:26

Fifty Shades of Kubernetes Autoscaling

Mario-Leander Reimer

Upcoming sessions on this topic

Open session

Build a Zero-Cost AI Agent in Your Browser

  • Aishwarya Mathuria

    Adobe

    Computer Scientist

  • Nishant Thakur

    Adobe

    Senior Computer Scientist

Open session

Your Server-Rendered App Doesn't Know Who It's Talking To

  • Anshul Bansal

    OLX India

    Principal Architect

Open session

Built-In AI in the Browser: Practical Capabilities for Modern Web Apps

  • Piyush Gupta

    Expedia

    Senior Engineering Manager

Open session

The Illusion of Green: Why AI-Generated Browser Automation Tests Pass Locally but Fail in CI

  • Puja Jagani

    BrowserStack

    Lead of Open Source and Developer Advocacy

Open session

More Agents. Fewer Tabs. Meet the GitHub Copilot App

  • Romaan Shair

    GitHub

    Senior Solutions Engineer

Open session

The Dream Team You Didn't Know You Had - Multi-Model, Multi-Agent, One Software Lifecycle

  • Aditya Dua

    GitHub

    Senior Manager, Field Services, SAARC

Related videos

Cracking the Code: Decoding Anti-Bot Systems! thumbnail
57:47

Cracking the Code: Decoding Anti-Bot Systems!

Fabien Vauchelles

LIVE · May 2024

How to scrape modern websites to feed AI agents thumbnail
19:20

How to scrape modern websites to feed AI agents

Jan Curn · Apify

World Congress · 2025

Scrape, Train, Predict: The Lifecycle of Data for AI Applications thumbnail
26:15

Scrape, Train, Predict: The Lifecycle of Data for AI Applications

Vidas Bacevičius · Oxylabs

World Congress · 2025

Modern Web Data Extraction: Techniques, Tools, and Legal & Ethical Considerations thumbnail
36:42

Modern Web Data Extraction: Techniques, Tools, and Legal & Ethical Considerations

Domagoj Marić · Pontis Technology

Europe Virtual · 2026

Automate everything via NodeJS and Puppeteer thumbnail
43:11

Automate everything via NodeJS and Puppeteer

Miki Lombardi

JS Congress · 2021

Data is Key: Scraping Metadata from Websites thumbnail
21:17

Data is Key: Scraping Metadata from Websites

Lars Kölker

World Congress · 2023

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.