Google To Add “Unavailable After” META Tag

Getting Into Google by Jill Whalen reports Dan Crow, director of crawl systems at Google, saying that Google is releasing a new META tag named “unavailable_after.”

The “unavailable_after” tag will allow you to tell Google when Googlebot should no longer crawl that page. Jill explains that this tag comes in handy when you have a limited time offer promotional page, and on this page, the promotion will expire on a specific date. By using the “unavailable_after” tag, you can tell Google that they should not crawl this page, after the promotion expires. There are several practical scenarios for this tag. We have emailed Dan Crow and others at Google for when this tag is expected to be supported.

Jill’s Getting Into Google has a lot of other useful and interesting topics, in my opinion, it is worth a full read.

Postscript: See more details in our followup post, More Info On Google’s Unavailable After Meta Tag & New X-Robots-Tag In Header Support.

Related Topics: Channel: SEO | Google: SEO | SEO: Blocking Spiders | SEO: Titles & Descriptions


About The Author: is Search Engine Land's News Editor and owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics. Barry's personal blog is named Cartoon Barry and he can be followed on Twitter here. For more background information on Barry, see his full bio over here.

Connect with the author via: Email | Twitter | Google+ | LinkedIn


Get all the top search stories emailed daily!  


Other ways to share:

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. Comments may also be removed if they are posted from anonymous accounts. You can read more about our comments policy here.
  • Michael Martinez

    It’s a good recap and I appreciate Jill’s writing about the session. But I am increasingly concerned about the message coming from Google regarding Supplemental Results pages.

    Simply removing “Supplemental Result” from the SERP listings won’t change the fact that Google only partially parses and indexes the Supplemental Results pages (a fact Matt Cutts confirmed at SMX Advanced 2007 in Seattle).

    If Google does not begin fully parsing and indexing the Supplemental Results pages then they need to keep the designation visible so that users and Webmasters alike know there is something different in the data they are seeing.

    Otherwise Google will be engaging in a deceptive trade practice by deliberately and intentionally misleading people regarding the way they process and present Web data information.

Get Our News, Everywhere!

Daily Email:

Follow Search Engine Land on Twitter @sengineland Like Search Engine Land on Facebook Follow Search Engine Land on Google+ Get the Search Engine Land Feed Connect with Search Engine Land on LinkedIn Check out our Tumblr! See us on Pinterest


Click to watch SMX conference video

Join us at one of our SMX or MarTech events:

United States


Australia & China

Learn more about: SMX | MarTech

Free Daily Search News Recap!

SearchCap is a once-per-day newsletter update - sign up below and get the news delivered to you!



Search Engine Land Periodic Table of SEO Success Factors

Get Your Copy
Read The Full SEO Guide