SEO

Google has updated its document on how to block Google Search

Google has updated its Control what you share with Google Search help document to add “include existing options such as the robots meta tag, data-nosnippet, X-Robots-Tag, and the Search generative AI control,” Google said.

What Google added. Google specifically added these two sections:

  • Use the Search generative AI control
  • Use robots meta tag, data-nosnippet, or X-Robots-Tag

Google said it made this change “to keep the page fresh and reflect the current set of options available to site owners.”

Here is a screenshot of what was added:

Addition Scaled

More updates. Google also made a number of smaller changes to the document – here is a diff of the changes:

Google Diff Scaled

Also, Google updated its URL structure best practices for Google Search help document this morning – these also were small updates.

Why we care. While these controls are not new, Google has decided to add it to the help documentation officially.

Controlling what Google Search can crawl, see, access, and use from your website is important for many site owners.

Explore more on

Artificial intelligence Generative AI Google Search Google Search engine optimization
Add Search Engine Land as a preferred source on Google

Editorial disclosure

Search Engine Land is owned by Semrush. We remain committed to providing high-quality coverage of marketing topics. Unless otherwise noted, this page’s content was written by either an employee or a paid contractor of Semrush Inc.

About the author

Barry Schwartz
Barry Schwartz is a technologist and a Contributing Editor to Search Engine Land and a member of the programming team for SMX events. He owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics.

In 2019, Barry was awarded the Outstanding Community Services Award from Search Engine Land, in 2018 he was awarded the US Search Awards the "US Search Personality Of The Year," you can learn more over here and in 2023 he was listed as a top 50 most influential PPCer by Marketing O'Clock.

Barry can be followed on X here and you can learn more about Barry Schwartz over here or on his personal site.