Fireside Chat with Cloudflare's Chief Strategy Officer, Stephanie Cohen (with Mike Butcher MBE)
What if website owners could charge AI companies for scraping their data? Cloudflare's CSO explains their new framework to block, allow, or charge for access.
#1about 2 minutes
Cloudflare's new default to block AI training crawlers
Cloudflare now defaults to blocking AI training crawlers, giving website owners the choice to block, allow, or charge for access via a new beta.
#2about 2 minutes
Creating a sustainable ecosystem for online content
The new crawler controls were developed in response to feedback from publishers and AI companies to ensure the continued creation of high-quality content.
#3about 1 minute
How to access the new crawler control features
To use the new pay-per-crawl beta and other AI crawler controls, users must proxy their traffic through Cloudflare, which is available on the free plan.
#4about 2 minutes
How the developer platform supports an AI ecosystem
Cloudflare's developer platform is optimized for AI agents with features like global distribution, data localization, and efficient CPU and GPU usage.
#5about 2 minutes
Verifying bots and agents with Web Bot Auth
Web Bot Auth provides cryptographic verification to confirm a bot's identity, preventing impersonation and ensuring trust in an agent-driven internet.
#6about 2 minutes
Preparing for a future with AI agents
The internet is evolving to be optimized for machines, and Cloudflare is enabling this shift with tools like a remote MCP and an agent SDK.
#7about 3 minutes
The evolving cybersecurity landscape with AI
AI increases cybersecurity risks like sophisticated DDoS attacks, making it crucial to differentiate between good and bad bots to protect websites.
#8about 3 minutes
How AI is changing human interaction with the web
As users shift from traditional search to AI-generated answers, it's essential to maintain incentives for human-created content to ensure a vibrant internet.
#9about 2 minutes
Ensuring content authenticity in the AI era
Initiatives like C2PA are crucial for verifying content authenticity, allowing users to know if media is human-generated and has not been altered.
#10about 3 minutes
How developers can build on and engage with Cloudflare
Developers are encouraged to experiment with Cloudflare's free tier, provide direct feedback, and leverage the global network to build their applications.
#11about 2 minutes
What to expect next from Cloudflare's innovation pipeline
Expect continuous product announcements on the company blog, special releases during the annual Birthday Week, and ongoing updates to the AI agent platform.
Related jobs
Jobs that call for the skills explored in this talk.
SEO in an AI world - Google vs. ChatGPT and survival tips for content creatorsIn the ever-evolving world of technology, the landscape of search engines and AI tools is shifting at an unprecedented pace. This transformational journey is being shaped by the rising influence of AI-powered tools like ChatGPT, which are increasingl...
Dev Digest 217: All About Cookies, Better Agents & How OpenAI Built CodexInside last week’s Dev Digest 217 .
🍪 All you ever wanted to know about cookies
🤖 Why ChatGPT cites one page over another
🛠️ How to build better agents
🌐 Is your site agent ready?
🔐 Get started on GitHub Actions security
🧠 How OpenAI built Codex
🧹 G...
From learning to earning
Jobs that call for the skills explored in this talk.