Yahoo Search Updating Index & Algorithm

We have been noticing reports from several sources of a Yahoo Search index and algorithm update. It is important to note that Yahoo has not yet posted their "weather report" at the Yahoo Search Blog yet. However Aaron Wall, Loren Baker and several forums have noticed major changes at Yahoo Search. Aaron noticed two main things: (1) What Aaron calls a "botch up" in how Yahoo handles sitewide 301 redirects. (2) Yahoo seems to be giving more weight to the words in a domain name. These are very early reports. Feel free to share your thoughts by Sphinning this article below! Postscript: It [...]

Meta Keywords Tag 101: How To “Legally” Hide Words On Your Pages For Search Engines

If there's anything I particularly hate when it comes to SEO, it's the meta keywords tag. I so wish it had never been invented. It's practically useless, yet people still obsess over it. In this article, I'll explain more about why you shouldn't worry about it except perhaps for misspellings, as well as which search engines support it. The meta keywords tag is one of several of meta tags that you can insert into your web pages to provide search engines with information about your pages that isn't visible on the page itself. For example, my Meta Robots Tag 101: Blocking Spiders, Cached Pages [...]

Yahoo Slurp Gets More Efficient & New Index Update

The Yahoo Search Blog announced that they have made major changes to their crawling process, plus rolled out a new update to their crawling, indexing and ranking systems. Recently, there have been many complaints that Yahoo's crawler, Yahoo Slurp, is crawling sites too heavily. Yahoo says it has taken this feedback and has improved their crawl process to have less of an impact on servers. You should notice a reduction in crawl load from Slurp, the company says. [...]

Yahoo July 2007 Search Update

The Yahoo Search Blog announced that they are currently rolling out a web search update. Priyank Garg's "weather report" said: We've been rolling out some changes to our fresh web data and crawling, indexing and ranking algorithms over the last few days. We expect the update will be completed by the weekend. You may see changes in the Yahoo Search results over the next couple days. [...]

Yahoo Search June 2007 Update

The Yahoo Search Blog announced that they are doing an index and ranking algorithm update. The update started last night and should be "complete very soon," said Priyank Garg of Yahoo Search. Yahoo's last update was just a few weeks ago on May 22nd. That update was a minor update. [...]

Yahoo Finalizes Slurps Move To New Address

The Yahoo Search Blog announced the transition of Yahoo Slurp, Yahoo's web crawler, from to is now complete. The IP addresses and the user-agent are remaining the same but the DNS lookup is different, it is now This does not apply to other Yahoo crawlers, including Yahoo China, Yahoo Shopping, Yahoo Travel and other Yahoo crawlers that have their own user agents. [...]

Yahoo Search Update Tonight – May 22nd

Tim Mayer of Yahoo informed us that there will be a Yahoo Search index update tonight. Tim said we should "expect minor changes" over the next few days. The update will conclude this Friday. [...]

Yahoo Supports New Robots-Nocontent Tag To Block Indexing Within A Page

For over a decade, search engines have supported standards allowing you to prevent pages from being spidered or included within a search index. Today, Yahoo now supports a new twist -- a way to flag that part of your page shouldn't be included in an index. It's called the robots-nocontent tag. Many search marketers have long struggled with the problem that the "core" content of a web page -- the main body copy or article -- can often seemed drowned out from a text analytics perspective by all the clutter around the content. That clutter is often ads, navigational links, cross promot [...]

Search Engines Unite On Sitemaps Autodiscovery

Last November, Google, Microsoft and Yahoo united to support sitemaps, a standardized method of submitting web pages through feeds to the search engines. Today, the three are now joined by in supporting the system and an extension of it called autodiscovery. This is where the major search engines will automatically locate your sitemaps file if the location is listed in a robots.txt file. Announcements are up from Google and Ask now Yahoo and Microsoft. Information on how to create sitemaps files can be found at the site. Aside from the sitemaps XML formal, you can al [...]

Yahoo Site Explorer Takes Mobile Feeds, Gains Report Spam Button

Site Explorer Matures a Bit More and Accepts Mobile Feeds from the Yahoo Search Blog covers how the Yahoo Site Explorer tool now accepts mobile submissions and feeds, gains the ability to input URLs for deletion and remove more than five at a time (see our Yahoo Site Explorer Adds Features: Delete URL From Index article for more about the remove feature in general), plus a new "Report Spam" button that's been added. [...]

Yahoo Slurp Moves To

The Yahoo Search Blog announced that Yahoo Slurp, Yahoo's web crawler, is moving from to In short, the user agent for Yahoo's crawler will remain "Yahoo! Slurp." However, reverse DNS lookups on the IP address by the true Yahoo crawler will now resolve to The transition should take "a few weeks." [...]

Yahoo Quick Links: The Official Word

Yahoo Quick Links are little links found beneath some of the search results at Yahoo Search. As an example, a search on barry schwartz at Yahoo Search brings up a Wikipedia entry for the other Barry Schwartz with Quick Links; it looks like this: I have been covering Yahoo Quick Links for a while and got some official answers from Yahoo about how they work. In short, Yahoo Quick Links can happen through both natural and paid means. Buying Yahoo Quick Links Yes, you can buy Quick Links for your listings. Yahoo told me "clients participating in Search Submit Pro can submit their Quick Lin [...]

Yahoo Removes Directory Links From Individual Search Results

Yahoo Removes Category (Directory) Links From Under Search Results at Search Engine Roundtable reports that Yahoo has removed the links from the individual search listings to the Yahoo Directory. In the past, if a page had a listing in the Yahoo Directory, that directory listing would be shown as part of the page's listing in web search results. Here is a before and after that illustrates this: Before: After: This seems to be a pretty big move from Yahoo. This is just one more step in the direction of folding the once very popular Yahoo Directory. Postscript: Search Engine Watch has c [...]

Link Count Updates At Google & Yahoo Search

This morning I reported that both Yahoo and Google are updating the number of links they account for each site. Yahoo! Search Link Update shows a number of webmasters reporting both increases and decreases in the number of links Yahoo is reporting at their Site Explorer Tool. Google Link Update Within Webmaster Central's Link Tool shows that currently, all reports from webmasters show an increase in the number of backlinks reported by Google Webmaster Central. [...]’s CEO, Jim Lanzone, Calls Yahoo Paid Inclusion “Hypocritical”

In a comment left at the Stepforth blog, Jim Lanzone,'s CEO, has said that he considers paid inclusion a "dis-service". Jim explains that he finds it "hypocritical to charge for something we need to do anyway," i.e. crawl the web to find quality pages to present to the searcher. In addition, Mr. Lanzone explains that it "blurs the line" between "paid content and editorial content" making it hard for the searcher to possibly trust the search results. Lanzone does not go as far to accuse Yahoo of skewing the results in favor of paid inclusion results. Lanzone does say that "Paid Incl [...]

Meta Robots Tag 101: Blocking Spiders, Cached Pages & More

Last week, I covered a new command for the meta robots tag -- one to prevent search engines from using Yahoo titles and descriptions. In doing that, a number of questions came up about the meta robots tag syntax itself. Google Webmaster Central has now posted "Using the robots meta tag," providing some clarity from Google. In addition, both Yahoo and Microsoft have also sent me information on using the tag. I'll run through what everyone says below, complete with charts for easy at-a-glance comparisons. The meta robots tag was an open standard created over a decade ago and designed initiall [...]

Yahoo Provides NOYDIR Opt-Out Of Yahoo Directory Titles & Descriptions

Yahoo! Search Support for 'NOYDIR' Meta Tags and Weather Update from the Yahoo Search Blog covers how at long last, you can now tell Yahoo to not use Yahoo Directory information to make a title and/or description for your web page listings. It also cover how Yahoo's currently doing a reindexing change that might impact rankings. More on that below, plus tips about also blocking the Open Directory information from being used for your pages and some possible conflicts with multiple robots tags. Sometimes pages are listed in both Yahoo's crawler-based search results and within its human-compil [...]

Finding Search Engine Freshness & Crawl Dates

A reader emailed me today noticing that Google was showing a date next to his listing, which made me think this was a good time to revisit how, when and where search engines show crawl dates for pages. These dates are a useful way for site owners to understand how often they are being revisited or for anyone to "squeeze the loaf" of a search engine to see how fresh it is. Here's a search engine-by-search engine rundown on date display. I'll also cover how we've sadly lost crawl dates being embedded next to listings, over the years. But that's not all! Read now and you'll even [...]

What Yahoo’s Panama Update Means For Searchers

Yesterday's rollout of Yahoo's new Panama search advertising ranking system has been both praised and criticized by advertisers (see Panama is LIVE! - for some and Yahoo's Panama: The Switch Is Flipped on The New Ad System). Praised, because the new system is streamlined, easier to use and offers more campaign management tools. Criticized, because the previously relatively simple system of higher bid equals higher placement has been replaced with a more complex formula that includes factors such as ad "quality," brand recognition and other variables that have reduced the transparency of the s [...]

Up Close With Yahoo’s New Delete URL Feature

Since Yahoo rolled out a new Delete URL feature this week, a number of questions have come up on how exactly it works. I had time yesterday with some of the Yahoo Site Explorer team to gather answers. Thanks to Priyank Garg and Amit Kumar, who along with Tim Mayer, went through the inner workings. It's probably most important to understand the difference between how pages have traditionally been kept out of Yahoo versus what Delete URL does. Traditionally, Yahoo is told not to spider pages at all using either a robots.txt file or a meta robots tag that uses the "noindex" setting. [...]

Get Our News, Everywhere!

Daily Email:

Follow Search Engine Land on Twitter @sengineland Like Search Engine Land on Facebook Follow Search Engine Land on Google+ Get the Search Engine Land Feed Connect with Search Engine Land on LinkedIn Check out our Tumblr! See us on Pinterest


Click to watch SMX conference video

Join us at one of our SMX or MarTech events:

United States


Australia & China

Learn more about: SMX | MarTech

Free Daily Search News Recap!

SearchCap is a once-per-day newsletter update - sign up below and get the news delivered to you!



Search Engine Land Periodic Table of SEO Success Factors

Get Your Copy
Read The Full SEO Guide