• http://twitter.com/Jeff_Martin Jeff_Martin

    “That’s means Search Monkey, which enables site owners to enhance how their results appear on Yahoo, is potentially safe.”

    I don’t believe this to be the case with video listings. You won’t be using the video solutions offered in SearchMonkey to get video listings in Bing (http://developer.search.yahoo.com/help/objects/video). Last I heard officially from Bing was that they were still working on a solution to accept video feeds/submissions into their results.

  • robertperro

    You say that “Several other companies offer web indices” and give Alexa and CommonCrawl as examples. Check the link to Alexa you gave – it states:
    “The Alexa Web Search web service has been deprecated and is no longer available for new subscriptions.”
    And CommonCrawl is showing little signs of life lately. Hopefully they are in some sort of hibernation, but their crawlers don’t appear to have been active since January of 2009. Care to list any other companies that really offer web indices? I’d like to know who they are.

    It appears to me that new search engines are limited to crawling the web directly. Quite a shame.

  • http://ninebyblue.com/ Vanessa Fox

    Jeff, you could indeed be correct with video. I was talking more generally about SearchMonkey applications that site owners can build to enhance their listings with things like photos, reviews, and links.

    I may edit the article to clarify that the structured content that Yahoo picks up to create its own enhanced listings is likely going away, since that requires a crawler.

    Robert, I don’t know anything about Majestic 12, but it looks like they’re trying to build an index of the web peer-to-peer style.

    80 legs provides a directed crawl and processing environment to help companies jump start the process:

    Of course there are a number of open-source crawlers out there (such as http://java-source.net/open-source/crawlers), but large-scale storage of a web index involves a great deal more than a basic crawler.

    Gigablast has some data and resources available, potentially:

    Hakia provides syndication, but this is likely to have restrictions similar to Google’s custom search engine:

    Anyone looked at this space more closely have any others to include?

  • kasi

    Guess I’ll need to step it up and pay more attention to how I’m ranking in Bing…dang!

  • http://www.brickmarketing.com nickstamoulis

    Great break down of the potential changes to Yahoo search. I personally agree with you there will not be anything game changing, and it has seemed like Yahoo’s search engineers have been alseep at the wheel for a while now :o)

  • http://www.irishwonder.com/blog/ IrishWonder

    Seen Yahoo experimenting some yesterday – they added an Ask-like sidebar with “related concepts” to search results and removed the total results count (screenshot here http://www.irishwonder.com/blog/2009/07/30/yahoo-displays-related-concepts-sidebar/ ) – then it was all back to normal again