Cloudflare and beehiiv give publishers new AI crawler controls
A new dashboard shows which AI bots hit newsletters, what got blocked and whether any of that crawling sends readers back.
A new dashboard shows which AI bots hit newsletters, what got blocked and whether any of that crawling sends readers back.
CEO Matthew Prince expected bots to outnumber humans by 2027. New Cloudflare data shows that the milestone has already arrived.
Automated traffic now exceeds human activity across the web. Machines aren't just indexing or scraping it. They're actively using it.
Matthew Prince says AI bots could soon surpass humans, driving massive traffic surges, breaking ad models, and reshaping search.
From probabilistic answers to off-site signals, AI visibility works differently than SEO. These seven truths explain how and why.
SEO vs. GEO. AI Mode expands. AI Overviews kill clicks. Goodbye, num=100. These were among the most popular and biggest SEO stories of 2025.
Google sees 3.2x more webpages than OpenAI. Cloudflare CEO Matthew Prince wants Google to separate search crawling from AI crawling.
Cloudflare’s new Content Signals limit AI use of your content via robots.txt. However, it’s unclear whether Google or others will comply.
Pay Per Crawl signals a new web business model – charging AI bots for access and giving content creators a new path to profit.
Major publications have already signed up, including Ziff Davis, The Atlantic, ADWEEK, BuzzFeed, Time, O’Reilly Media, Internet Brands, and more.
Clicks are vanishing and SEO playbooks are being rewritten. And Google has been telling us for a long time where this is all headed.
Google says AI Overviews drive better clicks, but offers little new guidance – even as AI Mode threatens to further shrink organic traffic.
MailOnline's Carly Steven warns that Google AI Overviews will have a dramatic impact on traffic, and search traffic will inevitably decline.
Google's value exchange with content creators has collapsed – and the web's business model is cracking, according to Matthew Prince.