Yahoo Site Explorer Adds Dynamic URL Rewriting Tool

The Yahoo Search Blog announced a new Site Explorer feature that enables webmasters to inform Yahoo about dynamic URLs that might be creating duplicate content issues or crawl barriers.

The new feature is named “Dynamic URL Rewriting,” and it allows webmasters to view potential duplicate content issues and have Yahoo rewrite those URLs at the index level. Yahoo allows you to define which URL is the primary, and the remaining URLs will be dynamically rewritten to that primary URL.

One of the most discussed advanced topics in SEO is duplicate content. Duplicate content can often be generated by accident by having automated dynamic URLs. How so? The URLs can append characters to the URLs such as session ids, tracking parameters, format modifiers and other parameters that do not change the content of the page but yet create a new unique looking URL. Savvy SEOs detect these duplicate URLs and use rewriting technology to inform the search engine of the primary URL. But sometimes webmasters forget.

This new tool will enable webmasters to easily identify these URLs and classify the primary versions of the URLs.

For example, say you set up a tracking URL for a banner ad such as, which is basically a duplicate URL for You can tell Yahoo that anything that conforms to the “ad_id” parameter following the ? will by a duplicate URL to the primary and Yahoo will rewrite the URL to default to the primary.

Here is a screen capture of the tool:

Yahoo Site Explorer Dynamic URL Feature

As you can see, Yahoo gives you two options with the tool

(1) Remove these parameters from the URLs, such as in case of session ids, you could ask to remove ‘sid’ from URLs (2) Use a default value for the parameter, for example you could set the ‘src’ parameter to be ‘yhoo_srch’

It currently seems you can apply up to three parameters for the rewriting or removal in this tool.

Yahoo has done a great job explaining how it works at the Yahoo Search Blog and over at Yahoo Site Explorer help.

Related Topics: Channel: SEO | SEO: Domain Names & URLs | SEO: Duplicate Content | SEO: Redirects & Moving Sites | Yahoo: Site Explorer


About The Author: is Search Engine Land's News Editor and owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics. Barry's personal blog is named Cartoon Barry and he can be followed on Twitter here. For more background information on Barry, see his full bio over here.

Connect with the author via: Email | Twitter | Google+ | LinkedIn


Get all the top search stories emailed daily!  


Other ways to share:

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. Comments may also be removed if they are posted from anonymous accounts. You can read more about our comments policy here.
  • f-lops-y

    Hey Barry, is there any info yet on if/when this tool will be supported by the other engines, or if they will be coming out with their own Dynamic URL management tools?

Get Our News, Everywhere!

Daily Email:

Follow Search Engine Land on Twitter @sengineland Like Search Engine Land on Facebook Follow Search Engine Land on Google+ Get the Search Engine Land Feed Connect with Search Engine Land on LinkedIn Check out our Tumblr! See us on Pinterest


Click to watch SMX conference video

Join us at one of our SMX or MarTech events:

United States


Australia & China

Learn more about: SMX | MarTech

Free Daily Search News Recap!

SearchCap is a once-per-day newsletter update - sign up below and get the news delivered to you!



Search Engine Land Periodic Table of SEO Success Factors

Get Your Copy
Read The Full SEO Guide