What The Government Shutdown Means For .gov SEO

government-govt-generic-240pxAs part of the US government shut down, many .gov sites have also shut down, replaced by messages like this:

“Due to the lapse in federal government funding, this website is not available. We sincerely regret this inconvenience.”

But one day, the government will start up again and government agencies will once again focus on ensuring that the information their sites provide is easily available to US citizens.

We know that Americans primarily use search to access government information, so once the shutdown is over, it won’t be enough that the web sites power up. They also need to be indexed and ranking in search engines such as Bing and Google for relevant queries.

And that may take a while.

The .gov sites that have shut down have done so in one of two ways:

  • The page content is replaced by an unavailable message. The URLs remain the same and return a 200 status code.
  • The pages 302 redirect to a different page that contains the unavailable message (and that second page returns a 200 status code).

Both scenarios result in the same outcome from an SEO perspective: the original URL remains indexed, but with the contents of the unavailable message. All of the context of what the pages are about will be lost and the only relevance clues will come from links to those pages.  That means that as the pages are recrawled they may stop ranking entirely for some queries and will rank lower for others.

That’s fine during the shutdown, since the pages aren’t available anyway, but once the sites are live again, it will take some time before the search engines recrawl the pages (think of the thousands and thousands of pages most .gov web sites contain) and the rankings return.

Let’s take a closer look at why this happens. (And of course, I’m not positive that this will in fact happen for .gov sites. The search engines are certainly aware of this situation and may implement special handling, such as pausing .gov site crawls and leaving the previous versions of the pages in the index during the shutdown.)

Scenario 1: Modified Page Content

In this scenario, the page content is replaced by an unavailable message and the pages return a 200 response code. You can see this, for instance, with www.census.gov.

All pages on the site contain the following content:

census site

As a result, as the pages are recrawled, the search index is updated with that content.

census unavailable

Scenario 2: 302 Redirect to Unavailable Message

In this scenario, the URLs 302 (temporarily) redirect to a different URL that contains the unavailable message.  You can see this, for instance, with www.nasa.gov.

www.nasa.gov redirects to notice.usa.gov:

usa notice

The typical search engine response to a 302 (temporary) redirect is to continue to index the first URL, but with the contents of the second URL.

nasa redirect

You can see in this example that www.nasa.gov remains indexed, but the page title and description are coming from notice.usa.gov, where www.nasa.gov currently redirects.

Bing has previously said that they may treat 302 redirects as 301 redirects, which would remove the URLs from the index entirely (see more on this below), so I’m not sure how they’re handling things in this case.

In some cases, Google is trying to construct a better title and description. You can see, for instance, with this query, that Google is using the description from the Open Directory Project:

nasa dmoz

Anytime you make large-scale changes to site infrastructure, things can go wrong (especially if your government has just shut down!) and NASA isn’t immune. In this case, they’re redirecting the www version of the site, but someone has forgotten the non-www version. So if you try going to nasa.gov, you simply get this:

nasa nonwww

And the National Park Service site (nps.gov) redirects to a page that looks like this:

nps

Scenario 3: 301 Redirect to Unavailable Message

None of the .gov sites I checked 301 (permanently) redirected to a different pages. In most cases, a 301 is always preferred over a 302, but in this case, the 302 is a much better way to go. A 301 tells search engines to drop the first URL from the index and replace it with the second URL. In this case, once the .gov sites were live again, the search engines would have to start from scratch on crawling and indexing the sites.

Is There A Better Way? How About 503?

This clearly isn’t a great situation. But could the sites have done anything to preserve search visibility? One option would be a 503 response code rather than a 200 (whether 302 redirecting or not.) A 503 is typically used when the server is down for maintenance and the search engines interpret as “leave the previous content indexed and come back later to try again”. And arguably, the government shutdown is “planned downtime”.

This would eliminate the potential lag time in search visibility once the sites are online again, as the content would remain indexed and associated with the pages.

Of course, in order for any of this to matter, the sites need to be live again. And the longer the shutdown lasts, the greater the number of pages that will need to be reindexed.

(Stock image via Shutterstock.com. Used under license.)

Related:

Opinions expressed in the article are those of the guest author and not necessarily Search Engine Land.

Related Topics: Features: Analysis | Google: SEO | Microsoft: Bing SEO | Search & Society: General | SEO - Search Engine Optimization | SEO: Redirects & Moving Sites | Top News

Sponsored


About The Author: is a Contributing Editor at Search Engine Land. She built Google Webmaster Central and went on to found software and consulting company Nine By Blue and create Blueprint Search Analytics< which she later sold. Her book, Marketing in the Age of Google, (updated edition, May 2012) provides a foundation for incorporating search strategy into organizations of all levels. Follow her on Twitter at @vanessafox.

Connect with the author via: Email | Twitter | Google+ | LinkedIn



SearchCap:

Get all the top search stories emailed daily!  

Share

Other ways to share:
 

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. Comments may also be removed if they are posted from anonymous accounts. You can read more about our comments policy here.
  • http://blackhatpwnage.com/ igl00

    theres also option google turned on auto filter to keep stuff indexed in the background and just make it ‘work’ when sites re back.

  • http://www.jaankanellis.com incrediblehelp

    These sites are no doubt going to get a “Google pass” like a big brand would. Let the little man die more.

  • Douglas Thomas

    I have a feeling most of these sites get the vast majority of their traffic from direct and referral vs. organic search anyway.

  • Illogicalthinker

    I disagree, since most .gov sites have huge confusing url structures. Take the VA form one used above as an example.

  • antiks (@antiks)

    Best Implementation of how you should do it: http://www.whitehouse.gov/

  • Chris Koszo

    Yup, and the easiest implementation as well. Maybe for liability reasons the other sites couldn’t get away with just that and had to actually pull the content.

  • Nikhil Raj. R

    What about sites that use a meta refresh tag like in the case of the National Park Service http://www.nps.gov ? They 302 to a notice page and then meta refreshes to http://www.doi.gov/index.cfm

  • Harry Hawk

    Crazy that the web sites have to shut down.. do they pay for hosting on a daily basis?

  • Travis Bailey

    Healthcare.gov has some glaring problems. Aside from using JS everywhere they humanly could, every URL is a 301 for lack of a trailing slash. That’s not going to be a huge waste of resources or anything.

  • Tim

    I don’t get it either. The cost of serving a website is peanuts. It sounds to me like something the employees would do out of spite.

  • lowlevel

    @Vanessa: one of the additional consequences of the 302 redirects is that they have been mistakenly applied to some robots.txt files as well. One nice addition to your article would be to describe how the sudden lack of (previously existing) Disallow and Crawl-delay directives will influence the index.

  • http://www.timbiden.com/ Tim Biden

    I’d never though about that. I just checked it in http://www.howto301redirect.com/301-redirect-checker/ and you’re right. It does 301 to put the trailing slash in the URL. Hilarious!

  • j0ebanks

    Regarding: “Anytime you make large-scale changes to site infrastructure, things can go wrong (especially if your government has just shut down!) and NASA isn’t immune. In this case, they’re redirecting the www version of the site, but someone has forgotten the non-www version. So if you try going to nasa.gov, you simply get this….”

    Actually, that’s always how it’s been with the non-www nasa.gov domain and is not due to the shutdown. Perhaps you can try notifying the person to change it, because I’ve given up. :)

Get Our News, Everywhere!

Daily Email:

Follow Search Engine Land on Twitter @sengineland Like Search Engine Land on Facebook Follow Search Engine Land on Google+ Get the Search Engine Land Feed Connect with Search Engine Land on LinkedIn Check out our Tumblr! See us on Pinterest

 
 

Click to watch SMX conference video

Join us at one of our SMX or MarTech events:

United States

Europe

Australia & China

Learn more about: SMX | MarTech


Free Daily Search News Recap!

SearchCap is a once-per-day newsletter update - sign up below and get the news delivered to you!

 


 

Search Engine Land Periodic Table of SEO Success Factors

Get Your Copy
Read The Full SEO Guide