60,000 websites using Cloudflare turned on IndexNow

IndexNow is an initiative by Microsoft and Yandex to push content to search engines that launched in October 2021.

Chat with SearchBot

IndexNow has now been turned on by over 60,000 websites that use Cloudflare in less than two months after IndexNow was announced by Microsoft. IndexNow is an open protocol that any search engine can participate in to enable site owners to have their pages and content instantly indexed by the search engine. 

Microsoft and Cloudflare announced today that “more than 60,000 unique websites that have opted-in to Crawler Hints. Those zones have sent Bing about billion Hints for when specific assets on their websites have changed and need to be re-crawled.” I turned it on for the Search Engine Roundtable, my personal search blog, when it was announced.

How to turn it on. It literally is controlled by the flip of a switch in Cloudflare under the crawler hints section that you can access under the cache tab, then under the configuration section:

Cloudflare Indexnow 1634576026

Microsoft said once this setting is enabled, IndexNow “will begin sending hints to search engines about when they should crawl particular parts of your website.”

Google may adopt it. Google said recently that it too will test the IndexNow protocol for indexing. So while Microsoft Bing and Yandex are the only two who have fully adopted it, if Google adopts it, you can expect other search engines to as well.

Why we care. Like we said before, instant indexing is an SEO’s dream when it comes to giving search engines the most updated content on a site. The protocol is very simple and it requires very little developer effort to add this to your site, so it makes sense to implement this if you care about speedy indexing. Plus if you use Cloudflare, it can be turned on with the flip of a switch.


About the author

Barry Schwartz
Staff
Barry Schwartz is a technologist and a Contributing Editor to Search Engine Land and a member of the programming team for SMX events. He owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics.

In 2019, Barry was awarded the Outstanding Community Services Award from Search Engine Land, in 2018 he was awarded the US Search Awards the "US Search Personality Of The Year," you can learn more over here and in 2023 he was listed as a top 50 most influential PPCer by Marketing O'Clock.

Barry can be followed on X here and you can learn more about Barry Schwartz over here or on his personal site.

Get the newsletter search marketers rely on.