WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2025 • Jul 17, 2025

Fireside Chat with Cloudflare's Chief Strategy Officer, Stephanie Cohen (with Mike Butcher MBE)

Stephanie Cohen , Mike Butcher

Stephanie Cohen declares that uncompensated AI scraping is unsustainable. Learn how Cloudflare is driving a permission-based web by blocking AI training crawlers by default.

Pause
Mute Enter Fullscreen
#1 about 2 min

Blocking AI training crawlers by default on networks

Enabling website owners to block AI crawlers or charge for content scraping.

#2 about 3 min

Balancing content creator incentives and AI training needs

High-quality AI development demands sustainable models that compensate original content authors.

#3 about 2 min

Accessing crawler management tools through a free proxy

Routing traffic through specific gateways enables detailed visibility and immediate control over web scrapers.

#4 about 2 min

Integrating AI management tools directly into developer platforms

Infrastructure optimized for AI environments enables scalable agent deployment through distributed physical networks.

#5 about 2 min

Verifying bot identities through cryptographic authentication protocols

Cryptographically signing bot traffic prevents malicious actors from bypassing indexing rules or spoofing legitimate agents.

#6 about 3 min

Optimizing web infrastructure for machine traffic and agents

Adapting the internet for programmatic access requires robust host interfaces and specialized software development kits.

#7 about 3 min

Defending networks against massive distributed denial of service attacks

Increasing automated bot volume amplifies the urgency for exact threat identification techniques at edge locations.

#8 about 4 min

Adapting to changes in traditional web search and traffic

The shift from standard search indexing to generative summaries fundamentally alters established internet navigation pathways.

#9 about 2 min

Verifying digital content authenticity through open validation standards

Implementing tracking standards like C2PA ensures transparent tracing of media origination and generative alterations.

#10 about 5 min

Engaging globally and expanding infrastructure operations engineering teams

Opening direct feedback loops and recruiting across new international tech hubs accelerates the deployment of novel capabilities.

Matching moments

1:24 min

Monetizing automated web scraping with Cloudflare pay per crawl

Brian Whippo Brian Whippo · WWC 2025

5:14 min

Analyzing the surge in internet bot and crawler traffic

Chris Heilmann +2 · LIVE

53 sec

Identifying technical hurdles with aggressive AI web crawlers

Klaus-M. Schremser Klaus-M. Schremser · WWC Europe 2026

2:18 min

Managing security risks introduced by autonomous AI agents

Christian Heilmann Christian Heilmann · WWC 2025

4:56 min

Q&A on platform discovery, security, and prompt injection

Rishabh Budhiraja Rishabh Budhiraja +1 · WWC Europe 2026

3:53 min

Balancing free public access with commercial AI licensing requirements

Prashanth Chandrasekar Prashanth Chandrasekar · WWC 2024

More from World Congress 2025

GenAI Security: Navigating the Unseen Iceberg thumbnail
24:33
10 months ago

GenAI Security: Navigating the Unseen Iceberg

Maish Saidel-Keesing

Behind the Code: How Women Are Powering the Future of AI thumbnail
30:28
12 months ago

Behind the Code: How Women Are Powering the Future of AI

Alexandra Wudel, Laura Moritz, Madalina Florean

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise? thumbnail
28:12
12 months ago

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise?

Justus Lumpe, Konstantin Vinogradov, Nils Eiteneyer, Stephan Wirris

AI in Leadership: How Technology is Reshaping Executive Roles thumbnail
28:19
12 months ago

AI in Leadership: How Technology is Reshaping Executive Roles

Bernd Datler, Jasmin Kaiser, Jeff Hausmann, Sonja Alvarez

The AI-Ready Stack: Rethinking the Engineering Org of the Future thumbnail
28:09
12 months ago

The AI-Ready Stack: Rethinking the Engineering Org of the Future

Alex Laubscher, Jan Oberhauser, Keno Dreßel, Mirko Novakovic

AI Sovereignty: What Does It Take? thumbnail
29:13
12 months ago

AI Sovereignty: What Does It Take?

Boris Hecker, Clemens Wasner, Robin Hermann, Sonja Alvarez

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Securing AI Agent Infrastructure: Identity, Attestation, and Trust at Scale

Abdel Fane

Founder of OpenA2A

Abdel Fane
Open session

World Congress 2026 North America

When Agents Became Users: Rearchitecting Identity and Permissions for AI at Scale

Yoav Gal, Dor Cohen

Yoav Gal
Dor Cohen
Open session

World Congress 2026 North America

AI Agents are Only as Smart as their Context: Building a Real-Time Context Engine at Intuit

Bharat Patel

Lead Software Engineer at Intuit

Bharat Patel
Open session

World Congress 2026 North America

Agentic commerce's dirty little secret, and what to do about it.

Joe Monastiero

Founder & CEO at visualAI

Joe Monastiero
Open session

World Congress 2026 North America

Building Stuff with GenAI - The Open Minded Workshop beyond OpenAI

Andreas Erben

CTO for Applied AI and Metaverse at daenet

Andreas Erben
Open session

World Congress 2026 North America

The Things Your AI Isn't Telling You

Desmond Lamptey

Lead Software Engineer @ Capital One

Desmond Lamptey

Related videos

Web Scraping, AI Agents, and the Future of Open Source - Kevin Lewis (Apify) thumbnail
40:29
Coffee With Developers • about 2 months ago

Web Scraping, AI Agents, and the Future of Open Source - Kevin Lewis (Apify)

Fighting the Next Wave of Cybercrime thumbnail
30:27
WWC Europe 2026 • about 1 month ago

Fighting the Next Wave of Cybercrime

Michele Zuccala, Misha Bragin, Ross Kukulinski, Frank Schlesinger, Tomislav Tipurić

Exploring AI: Opportunities and Risks in Development thumbnail
35:01
LIVE • over 1 year ago

Exploring AI: Opportunities and Risks in Development

Angie Jones, Kent C Dobbs, Liran Tal, Chris Heilmann

WeAreDevelopers LIVE - Web Performance in an AI World thumbnail
1:07:59
LIVE • 26 days ago

WeAreDevelopers LIVE - Web Performance in an AI World

Chris Heilmann, Daniel Cranney

WeAreDevelopers LIVE – AI vs the Web & AI in Browsers thumbnail
53:46
LIVE • 10 months ago

WeAreDevelopers LIVE – AI vs the Web & AI in Browsers

Chris Heilmann, Daniel Cranney, Raymond Camden

WeAreDevelopers LIVE – AI and Privacy, On-Device AI and More thumbnail
1:00:55
LIVE • 7 months ago

WeAreDevelopers LIVE – AI and Privacy, On-Device AI and More

Chris Heilmann, Daniel Cranney, Tarek Ziadé

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.