Google To Add “Unavailable After” META Tag

Getting Into Google by Jill Whalen reports Dan Crow, director of crawl systems at Google, saying that Google is releasing a new META tag named “unavailable_after.” The “unavailable_after” tag will allow you to tell Google when Googlebot should no longer crawl that page. Jill explains that this tag comes in handy when you have a […]

Chat with SearchBot

Getting Into Google by Jill Whalen reports Dan Crow, director of crawl systems at Google, saying that Google is releasing a new META tag named “unavailable_after.”

The “unavailable_after” tag will allow you to tell Google when Googlebot should no longer crawl that page. Jill explains that this tag comes in handy when you have a limited time offer promotional page, and on this page, the promotion will expire on a specific date. By using the “unavailable_after” tag, you can tell Google that they should not crawl this page, after the promotion expires. There are several practical scenarios for this tag. We have emailed Dan Crow and others at Google for when this tag is expected to be supported.


Jill’s Getting Into Google has a lot of other useful and interesting topics, in my opinion, it is worth a full read.

Postscript: See more details in our followup post, More Info On Google’s Unavailable After Meta Tag & New X-Robots-Tag In Header Support.


About the author

Barry Schwartz
Staff
Barry Schwartz is a Contributing Editor to Search Engine Land and a member of the programming team for SMX events. He owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics. Barry can be followed on Twitter here.

Get the must-read newsletter for search marketers.