<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Search Engine Land &#187; Google: Webmaster Central</title>
	<atom:link href="http://searchengineland.com/library/google/google-webmaster-central/feed" rel="self" type="application/rss+xml" />
	<link>http://searchengineland.com</link>
	<description>Search Engine Land: News On Search Engines, Search Engine Optimization (SEO) &#38; Search Engine Marketing (SEM)</description>
	<lastBuildDate>Fri, 25 May 2012 23:34:25 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.2.1</generator>
<xhtml:meta xmlns:xhtml="http://www.w3.org/1999/xhtml" name="robots" content="noindex" />
		<item>
		<title>Google Webmaster Tools Cleans Up With Dashboards, New Navigation &amp; More</title>
		<link>http://searchengineland.com/google-webmaster-tools-cleans-up-with-dashboards-new-navigation-more-120492</link>
		<comments>http://searchengineland.com/google-webmaster-tools-cleans-up-with-dashboards-new-navigation-more-120492#comments</comments>
		<pubDate>Tue, 08 May 2012 13:36:17 +0000</pubDate>
		<dc:creator>Barry Schwartz</dc:creator>
				<category><![CDATA[Google: SEO]]></category>
		<category><![CDATA[Google: Webmaster Central]]></category>
		<category><![CDATA[Top News]]></category>

		<guid isPermaLink="false">http://searchengineland.com/?p=120492</guid>
		<description><![CDATA[Google announced on the Webmaster Central blog that they have cleaned up Google Webmaster Tools. The three changes include: (1) Updated Dashboard (2) New Left Hand Navigation (3) Home Compact View Here is a picture of the revised dashboard: The new navigation was changed to be more representative of the content and tools within the [...]]]></description>
			<content:encoded><![CDATA[<p><img class="alignright size-full wp-image-120494" title="Google-Webmaster-Report-1330957203" src="http://searchengineland.com/figz/wp-content/seloads/2012/05/Google-Webmaster-Report-1330957203.gif" alt="" width="167" height="141" />Google <a href="http://googlewebmastercentral.blogspot.com/2012/05/navigation-dashboard-and-home-page.html">announced</a> on the Webmaster Central blog that they have cleaned up Google Webmaster Tools. The three changes include:</p>
<p>(1) Updated Dashboard
(2) New Left Hand Navigation
(3) Home Compact View</p>
<p>Here is a picture of the revised dashboard:</p>
<p><img class="alignnone size-large wp-image-120493" title="google-wmt-dashboard-1336434605" src="http://searchengineland.com/figz/wp-content/seloads/2012/05/google-wmt-dashboard-1336434605-600x210.png" alt="" width="600" height="210" /></p>
<p>The new navigation was changed to be more representative of the content and tools within the portal. Google explained:</p>
<ul>
<li>Configuration: Things you configure and generally don’t change very often.</li>
<li>Health: Where you look to make sure things are OK.</li>
<li>Traffic: Where you go to understand how your site is doing in Google search, who’s linking to you; where you can explore the data about your site.</li>
<li>Optimization: Where you can find ideas to enhance your site, which enables us to better understand and represent your site in Search and other services.</li>
</ul>
<h3>Related Stories:</h3>
<ul>
<li><a href="http://searchengineland.com/google-webmaster-tools-expands-query-data-to-90-days-119602">Google Webmaster Tools Expands Query Data to 90 Days</a></li>
<li><a href="http://searchengineland.com/google-webmaster-tools-provides-details-on-duplicate-content-across-domains-99246">Do You Have Duplicate Content Issues Across Domain? Google Will Now Alert You</a></li>
<li><a href="http://searchengineland.com/google-webmaster-tools-crawl-errors-how-to-get-detailed-data-from-the-api-115153">Google Webmaster Tools Crawl Errors: How To Get Detailed Data From the API</a></li>
<li><a href="http://searchengineland.com/google-webmaster-tools-adds-useful-download-options-108684">Google Webmaster Tools Adds Useful Download Options</a></li>
<li><a href="http://searchengineland.com/google-webmaster-tools-finally-adds-user-administration-113865">Google Webmaster Tools Finally Adds User Administration</a></li>
<li><a href="http://searchengineland.com/google-webmaster-tools-revamps-crawl-errors-but-is-it-for-the-better-114892">Google Webmaster Tools Revamps Crawl Errors, But Is It For The Better?</a></li>
<li><a href="http://searchengineland.com/google-1-reporting-now-in-google-webmaster-tools-83798">Google +1 Reporting Now In Google Webmaster Tools</a></li>
</ul>
]]></content:encoded>
			<wfw:commentRss>http://searchengineland.com/google-webmaster-tools-cleans-up-with-dashboards-new-navigation-more-120492/feed</wfw:commentRss>
		<slash:comments>17</slash:comments>
		</item>
		<item>
		<title>Discover Links Using Google Analytics New Backlink URL Report</title>
		<link>http://searchengineland.com/google-analytics-backlink-report-120235</link>
		<comments>http://searchengineland.com/google-analytics-backlink-report-120235#comments</comments>
		<pubDate>Thu, 03 May 2012 21:09:50 +0000</pubDate>
		<dc:creator>Daniel Waisberg</dc:creator>
				<category><![CDATA[Google]]></category>
		<category><![CDATA[Google: Analytics]]></category>
		<category><![CDATA[Google: Webmaster Central]]></category>
		<category><![CDATA[Top News]]></category>

		<guid isPermaLink="false">http://searchengineland.com/?p=120235</guid>
		<description><![CDATA[Today the Google Analytics team announced that we will start seeing backlink URLs in their newly released Social Reports. According to the announcement post, written by Ilya Grigorik, Software Engineering Manager, Google Analytics (and PostRank Founder): &#8220;These reports provide another layer of social insight showing which of your content attracts links, and enables you to [...]]]></description>
			<content:encoded><![CDATA[<p><a href="http://searchengineland.com/google-analytics-update-to-organic-reports-111029/google-analytics-2" rel="attachment wp-att-111042"><img class="alignright size-thumbnail wp-image-111042" title="google analytics icon" src="http://searchengineland.com/figz/wp-content/seloads/2012/02/google-analytics-100x100.png" alt="google analytics icon" width="100" height="100" /></a>Today the Google Analytics team announced that we will start seeing backlink URLs in their newly released <a href="http://marketingland.com/google-analytics-social-reports-8138">Social Reports</a>. According to the <a href="http://analytics.blogspot.com/2012/05/expanding-google-analytics-social.html" target="_blank">announcement post</a>, written by <a href="http://www.igvita.com/" target="_blank">Ilya Grigorik</a>, Software Engineering Manager, Google Analytics (and PostRank Founder):</p>
<p><em>&#8220;These reports provide another layer of social insight showing which of your content attracts links, and enables you to keep track of conversations across other sites that link to your content. Most website and blog owners had no easy mechanism to do this in the past, but we see it as another important feature for holistic social media reports. When you know what your most linked content is, it is then also much easier to replicate the success and ensure that you are building relationships with those users who actively link to you the most.&#8221;</em></p>
<h2>Where To Find The Backlink URLs Report</h2>
<p>The Backlink information is not easy to find. First visit the pages tab on the Social reports (<a href="https://www.google.com/analytics/web/?pli=1#report/social-pages/a944695w1628266p1636011/" target="_blank">this link</a> should take you directly to this report). Then click on a specific URL. Here is what you will see now:</p>
<p><a href="http://searchengineland.com/google-analytics-backlink-report-120235/google-analytics-backlink" rel="attachment wp-att-120238"><img class="size-full wp-image-120238 aligncenter" title="google analytics backlink" src="http://searchengineland.com/figz/wp-content/seloads/2012/05/google-analytics-backlink.jpg" alt="google analytics backlink" width="550" height="412" /></a></p>
<p>As indicated in the screenshot above, click on the <em>Activity Stream</em> tab above the graphs. Then you will arrive at another page that gathers all <a href="http://marketingland.com/google-analytics-social-data-hub-553">Social Data Hub</a> conversations related to this specific page, as seen below:</p>
<p><a href="http://searchengineland.com/google-analytics-backlink-report-120235/social-conversations" rel="attachment wp-att-120239"><img class="size-full wp-image-120239 aligncenter" title="social conversations" src="http://searchengineland.com/figz/wp-content/seloads/2012/05/social-conversations.jpg" alt="social conversations" width="550" height="308" /></a></p>
<p>If you click the <em>Events</em> tab shown above you will find the Backlinks information. This information appears among all other social events like +1s, Delicious bookmarks, and others. For each backlink URL you will be able to <em>View Activity</em>, i.e. visit the page with link, or to <em>View Page</em>, i.e. view the page linked.</p>
<p><a href="http://searchengineland.com/google-analytics-backlink-report-120235/backlinks-report" rel="attachment wp-att-120242"><img class="size-full wp-image-120242 aligncenter" title="backlinks report" src="http://searchengineland.com/figz/wp-content/seloads/2012/05/backlinks-report.jpg" alt="backlinks report" width="550" height="331" /></a></p>
<p>As you will see in the reports, <strong>while this information is very useful, it is still lacking a centralized place where users can see all the linked pages aggregated</strong>. The way this information is being organized is very focused on Social Media professionals, it treats links as another event related to the post. And the reports do not allow any filtering or segmentation. If we look at the Webmaster Tools (screenshot below), the information is more focused on SEOs, showing in a glance where the links are coming from and to which pages.</p>
<blockquote><em>Postscript 1: According to a comment by Ilya Grigorik on a <a href="https://plus.google.com/116146629736928473044/posts/K8jj7pWWaEN" target="_blank">Google+ post</a>, there is a way to find the centralized information in the reports, here is his explanation on how to do it.</p>
<p>I should also point out that there is indeed a way for users to see all of the linked pages aggregated, though it requires some GA ninja tricks at the moment. We&#8217;re working on making it more intuitive for users. Here it is:</p>
<ol>
<ol>
<li>Just as you outlined in the post, navigate to &#8220;Pages&#8221;, select a URL, click on &#8220;Activity Stream&#8221; &#8211; this shows you the activitystream for just that URL</li>
<li>Ninja trick #1: At the top of the page where it shows the breadcrumb with the current page, click on &#8220;ALL&#8221; &#8211; this report will show you all activity across all the pages in chronological order.</li>
<li>Ninja trick #2: Scroll down to any trackback activity and click on the (green) trackback icon: this filters the activitystream to just trackbacks.. And voila, you see a list of most recent trackbacks across all of your pages.</li>
</ol>
<p></em></blockquote>
<p><a href="http://searchengineland.com/google-analytics-backlink-report-120235/webmaster-tools-links" rel="attachment wp-att-120245"><img class="size-full wp-image-120245 aligncenter" title="webmaster tools links" src="http://searchengineland.com/figz/wp-content/seloads/2012/05/webmaster-tools-links.jpg" alt="webmaster tools links" width="550" height="290" /></a></p>
<h2>Social Signals And Backlinks In The Same Bucket</h2>
<p>This addition is interesting in that Google decided to add this information to the Social reports instead of adding it to the <a href="http://searchengineland.com/google-analytics-to-add-search-query-data-from-webmaster-tools-80442">SEO reports</a>. This decision makes sense from a Google Analytics perspective as this information, like all other Social information, is a factor that happens outside the website and, as such, it could be analyzed in the same way we <a href="http://online-behavior.com/analytics/googleplus">analyze</a> Google+ activity.</p>
<p>However, this information is more often used by SEOs in order to optimize pages and understand which pages are getting the most links. As discussed above, it appears that these reports are more focused on Social Media professionals rather than SEO professionals.</p>
<p>It is also interesting to look at this in the light of Danny Sullivan&#8217;s <a href="http://searchengineland.com/what-social-signals-do-google-bing-really-count-55389">post</a> discussing Social signals for Google and Bing, <strong>this decision shows how backlinks and social signals are seen as part of the same bucket</strong>.</p>
]]></content:encoded>
			<wfw:commentRss>http://searchengineland.com/google-analytics-backlink-report-120235/feed</wfw:commentRss>
		<slash:comments>30</slash:comments>
		</item>
		<item>
		<title>Google Webmaster Tools Expands Query Data to 90 Days</title>
		<link>http://searchengineland.com/google-webmaster-tools-expands-query-data-to-90-days-119602</link>
		<comments>http://searchengineland.com/google-webmaster-tools-expands-query-data-to-90-days-119602#comments</comments>
		<pubDate>Thu, 26 Apr 2012 21:19:00 +0000</pubDate>
		<dc:creator>Vanessa Fox</dc:creator>
				<category><![CDATA[Features: Analysis]]></category>
		<category><![CDATA[Google: Webmaster Central]]></category>
		<category><![CDATA[Top News]]></category>

		<guid isPermaLink="false">http://searchengineland.com/?p=119602</guid>
		<description><![CDATA[Today, Google has expanded the historical search query data to 90 days. The number of queries reported has increased as well: the report will now list the top 2,000 for each day of the selected date range (vs. the previous top 1,000). This is great news, as this is data not available anywhere else and [...]]]></description>
			<content:encoded><![CDATA[<p>Today, Google has <a href="http://googlewebmastercentral.blogspot.com/2012/04/even-more-top-search-queries-data.html">expanded</a> the historical search query data to 90 days. The number of queries reported has increased as well: the report will now list the top 2,000 for each day of the selected date range (vs. the previous top 1,000). This is great news, as this is data not available anywhere else and when looking at trends, the more information, the better. Google has made a few other minor adjustments to this data recently. So if you use Google webmaster tools query data, see below for all the details of how these reports work.</p>
<h2>What&#8217;s In the Top Search Queries Report</h2>
<p>First, a refresher on what this data is all about. The top search queries report (available in Google webmaster tools for sites you&#8217;ve verified ownership of by selecting <strong>Your site on the web &gt; Search queries</strong>) lists the top queries that brought traffic to your site from Google organic search (from all countries and properties).</p>
<h3>Summary Data</h3>
<p>For the selected data range, the report shows the total number of queries that brought traffic to the site, the total impressions and clicks the site received, and the number of impressions and clicks for the reported top queries.</p>
<h3>Query-Specific Data</h3>
<p>For each query, the report notes:</p>
<ul>
<li><strong>Number of impressions</strong> - how many searchers saw the site in search results for that query</li>
<li><strong>Number of clicks</strong> - how many searchers clicked on the search result for that query</li>
<li><strong>Click through rate</strong> - The percentage of the time searchers who saw the site in search results for that query clicked on it</li>
<li><strong>Average position</strong> - the average position the highest ranked URL for that site appeared in search results for the query across all searchers</li>
<li>In addition, you can find out the change for each of these data points from the previous period. However, the change percentages aren&#8217;t available for time periods longer than 30 days. The change details used to be visible by default, but they&#8217;re now off by default. You&#8217;ll need to click the <strong>With Change</strong> button to see them in the report (although they&#8217;ll be included automatically with the CSV download). If you have the change percentage displayed, you&#8217;ll need to turn that off in order to expand the date range beyond 30 days.</li>
</ul>
<p>You can click into any query to get more specific data, including the pages that ranked for the query, and the impressions, clicks, and click-through rate at each position the site ranked.</p>
<h3>Country and Property-Specific Data</h3>
<p>Use the filters to drill into what queries brought traffic from Google properties (web, video, images, mobile web, and smartphones) and from specific countries.</p>
<h2>How the Numbers Are Aggregated</h2>
<p>As I <a href="http://searchengineland.com/google-webmaster-tools-adds-useful-download-options-108684">explained in a previous post</a>, the numbers can be tricky and it&#8217;s important to understand what data you&#8217;re really looking at. These reports now list the top 2,000 queries that brought traffic to the site for the selected time period. That means that if a query wasn&#8217;t one of the top 2,000 for any days in the selected range, data won&#8217;t be reported for it. In the example below, the time period is 30 days, but only 6 of those days have data reported for the query (as illustrated by the dots in the graph).</p>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/04/queries.png"><img class="alignnone size-large wp-image-119616" style="border-image: initial; border-width: 1px; border-color: black; border-style: solid;" title="Google webmaster tools top queries graph" src="http://searchengineland.com/figz/wp-content/seloads/2012/04/queries-600x127.png" alt="Google webmaster tools top queries graph" width="600" height="127" /></a></p>
<h2>Generating Data</h2>
<p>When generating or downloading the data, keep in mind the following:</p>
<ul>
<li>The default ending data in the user interface display is today&#8217;s date, but reporting is typically 2-3 days behind so check the last date reported in the graph by hovering over the last dot. The default starting date of the range is 30 days before the end date. And because this end date is generally three days ahead of what&#8217;s actually reported, the actual date range generally shown by default is 27 days. Make sure you adjust the dates before analyzing data or comparing it to other time periods.</li>
<li>Because the default shown date range is 27 days, the download available from the Python script is also 27 days.</li>
</ul>
<div>It&#8217;s great that Google is offering more data (both number of queries and length of time). Just be sure that as you use this data, you understand exactly what you&#8217;re looking at and comparing (both in terms of data range and date reported per day).</div>
]]></content:encoded>
			<wfw:commentRss>http://searchengineland.com/google-webmaster-tools-expands-query-data-to-90-days-119602/feed</wfw:commentRss>
		<slash:comments>12</slash:comments>
		</item>
		<item>
		<title>Site Performance, Subscriber Stats &amp; Robots.txt Tool Removed From Google Webmaster Tools</title>
		<link>http://searchengineland.com/site-performance-subscriber-stats-robots-txt-tool-removed-from-google-webmaster-tools-119460</link>
		<comments>http://searchengineland.com/site-performance-subscriber-stats-robots-txt-tool-removed-from-google-webmaster-tools-119460#comments</comments>
		<pubDate>Wed, 25 Apr 2012 13:33:01 +0000</pubDate>
		<dc:creator>Barry Schwartz</dc:creator>
				<category><![CDATA[Google: SEO]]></category>
		<category><![CDATA[Google: Webmaster Central]]></category>

		<guid isPermaLink="false">http://searchengineland.com/?p=119460</guid>
		<description><![CDATA[Google announced they are removing three features from Google Webmaster Tools. Google made the announcement on the Google Webmaster Central blog saying the three features going away include the site performance report, the subscriber stats and the robots.txt creation tool. Google placed reversed the order of these features when they wrote about it, trying to [...]]]></description>
			<content:encoded><![CDATA[<p><img src="http://searchengineland.com/figz/wp-content/seloads/2012/04/google-webmaster-tools-cleaning.jpg" alt="" title="google-webmaster-tools-cleaning" width="300" height="262" class="alignright size-full wp-image-119461" />Google <a href="http://googlewebmastercentral.blogspot.com/2012/04/webmaster-tools-spring-cleaning.html">announced</a> they are removing three features from Google Webmaster Tools.  Google made the announcement on the Google Webmaster Central blog saying the three features going away include the site performance report, the subscriber stats and the robots.txt creation tool.</p>
<p>Google placed reversed the order of these features when they wrote about it, trying to mitigate the importance of removing some of these features.  Site Performance going away is going to be frustrating for a lot of Google Webmaster Tools users.  Subscriber stats is not as important and robots.txt is really not a big deal for most webmasters.</p>
<h3>Site Performance:</h3>
<p>Site performance is a <a href="http://support.google.com/webmasters/bin/answer.py?hl=en&amp;answer=106792">Webmaster Tools Labs</a> feature that provides information about the average load time of your site&#8217;s pages. This feature is also being removed due to low usage. Now you might have heard our announcement from a couple of years ago that the latency of a  site&#8217;s pages is a <a href="http://googlewebmastercentral.blogspot.com/2010/04/using-site-speed-in-web-search-ranking.html">factor in our search ranking algorithms</a>. This is still true, and you can analyze your site&#8217;s performance using the <a href="http://analytics.blogspot.com/2012/03/measure-your-websites-performance-with.html">Site Speed</a> feature in Google Analytics or using Google&#8217;s <a href="https://developers.google.com/pagespeed/">PageSpeed</a> online. There are also many other site performance analysis tools available like <a href="http://www.webpagetest.org/">WebPageTest</a> and the <a href="http://yslow.org/">YSlow</a> browser plugin.</p>
<h3>Subscriber Stats:</h3>
<p>Subscriber stats reports the number of subscribers to a site&#8217;s RSS or Atom feeds. This functionality is currently provided in Feedburner, another Google product which offers its own subscriber stats as well as other cool features specifically geared for <a href="http://support.google.com/feedburner/bin/answer.py?hl=en&amp;answer=79408">feeds</a> of all types. If you are looking for a replacement to Subscriber stats in Webmaster Tools, check out <a href="http://feedburner.google.com/">Feedburner</a>.</p>
<h3>Robots.txt Tool:</h3>
<p>The Create robots.txt tool provides a way to generate <a href="http://support.google.com/webmasters/bin/answer.py?hl=en&amp;answer=35303">robots.txt</a> files for the purpose of blocking specific parts of a site from being crawled by Googlebot. This feature has very low usage, so we&#8217;ve decided to remove it from Webmaster Tools. While many websites don&#8217;t even need a robots.txt file, if you feel that you do need one, it&#8217;s easy to make one yourself in a text editor or use one of the many other tools available on the web for generating robots.txt files.</p>
<p><small><i>Image credit to <A href="http://www.shutterstock.com/pic.mhtml?id=77816671">ShutterStock</a>.</i></small></p>
]]></content:encoded>
			<wfw:commentRss>http://searchengineland.com/site-performance-subscriber-stats-robots-txt-tool-removed-from-google-webmaster-tools-119460/feed</wfw:commentRss>
		<slash:comments>5</slash:comments>
		</item>
		<item>
		<title>Google Sent 20,000+ Hacked Notification Messages To Webmasters Today</title>
		<link>http://searchengineland.com/google-sent-20000-hacked-notification-messages-to-webmasters-today-118585</link>
		<comments>http://searchengineland.com/google-sent-20000-hacked-notification-messages-to-webmasters-today-118585#comments</comments>
		<pubDate>Mon, 16 Apr 2012 17:30:04 +0000</pubDate>
		<dc:creator>Barry Schwartz</dc:creator>
				<category><![CDATA[Google: Security]]></category>
		<category><![CDATA[Google: Web Search]]></category>
		<category><![CDATA[Google: Webmaster Central]]></category>

		<guid isPermaLink="false">http://searchengineland.com/?p=118585</guid>
		<description><![CDATA[Google&#8217;s head of the webspam team, Matt Cutts, announced on Twitter that they have sent out new message notifications to 20,000 web sites that are hacked. Specifically, Google sent these messages to sites doing &#8220;weird redirects.&#8221; I&#8217;ve personally seen a spike in the number of sites redirecting from their web site to a non-authorized site [...]]]></description>
			<content:encoded><![CDATA[<p><img src="http://searchengineland.com/figz/wp-content/seloads/2012/04/site-hacked-google.png" alt="" title="site-hacked-google" width="255" height="118" class="alignright size-full wp-image-118586" />Google&#8217;s head of the webspam team, Matt Cutts, announced on <a href="https://twitter.com/#!/mattcutts/status/191900489988849664">Twitter</a> that they have sent out new message notifications to 20,000 web sites that are hacked.</p>
<p>Specifically, Google sent these messages to sites doing &#8220;weird redirects.&#8221;  I&#8217;ve personally seen a spike in the number of sites redirecting from their web site to a non-authorized site recently.  The webmaster is typically unaware of this redirect because the redirects only occur when someone clicks from Google&#8217;s search results to the web site.  Typically the site owner doesn&#8217;t go to Google to find his web site; the site owner goes directly to the site.</p>
<p>To help webmasters and site owners become aware of this hack, Google has sent out messages to about 20,000 sites effected by this to give them the heads up.</p>
<p>Here is Matt Cutts&#8217; tweet:</p>
<blockquote class="twitter-tweet">
<p>Is your site doing weird redirects? We just sent a &#8220;your site might be hacked&#8221; msg to 20K sites, e.g. <a href="http://t.co/r9jOkiOm" title="http://goo.gl/S6Ptk">goo.gl/S6Ptk</a></p>
<p>&mdash; Matt Cutts (@mattcutts) <a href="https://twitter.com/mattcutts/status/191900489988849664" data-datetime="2012-04-16T14:46:56+00:00">April 16, 2012</a></blockquote>
<p><script src="//platform.twitter.com/widgets.js" charset="utf-8"></script></p>
<p>For more on hacked sites and malware, see <a href="http://support.google.com/webmasters/bin/answer.py?hl=en&#038;answer=163633">this Google document</a>.</p>
<h3>Related Stories:</h3>
<ul>
<li><a href="http://searchengineland.com/matt-cutts-on-appealing-google-malware-warnings-10247">Matt Cutts On Appealing Google Malware Warnings</a></li>
<li><a href="http://searchengineland.com/google-warns-of-malware-redirecting-to-its-search-listings-86426">Google Warns Of Malware Redirecting To Its Search Results</a></li>
<li><a href="http://searchengineland.com/google-adds-site-hacked-notifications-to-search-results-59103">Google Adds Site Hacked Notifications To Search Results</a></li>
<li><a href="http://searchengineland.com/google-search-results-now-may-display-malware-warnings-10502">Google Search Results Now May Display Malware Warnings</a></li>
<li><a href="http://searchengineland.com/google-warns-of-malware-redirecting-to-its-search-listings-86426">Google Warns Of Malware Redirecting To Its Search Results</a></li>
</ul>
]]></content:encoded>
			<wfw:commentRss>http://searchengineland.com/google-sent-20000-hacked-notification-messages-to-webmasters-today-118585/feed</wfw:commentRss>
		<slash:comments>9</slash:comments>
		</item>
		<item>
		<title>Google: No, We Don’t Use Akismet To Catch Link Spam</title>
		<link>http://searchengineland.com/google-no-we-don%e2%80%99t-use-akismet-to-catch-link-spam-117565</link>
		<comments>http://searchengineland.com/google-no-we-don%e2%80%99t-use-akismet-to-catch-link-spam-117565#comments</comments>
		<pubDate>Thu, 05 Apr 2012 18:28:18 +0000</pubDate>
		<dc:creator>Barry Schwartz</dc:creator>
				<category><![CDATA[Google: SEO]]></category>
		<category><![CDATA[Google: Webmaster Central]]></category>

		<guid isPermaLink="false">http://searchengineland.com/?p=117565</guid>
		<description><![CDATA[There&#8217;s speculation going around that Google is using data from the comment spam filter Akismet to penalize web sites. Those rumors are untrue, Google says. &#8220;We don&#8217;t use Akismet to flag spam,&#8221; a Google spokesperson told us, after talking with Google&#8217;s spam team. One oddity in the speculation was this: She stated that Google had left a [...]]]></description>
			<content:encoded><![CDATA[<p><img class="alignright size-full wp-image-117566" title="Akismet_logo" src="http://searchengineland.com/figz/wp-content/seloads/2012/04/Akismet_logo.png" alt="" width="245" height="43" />There&#8217;s <a href="http://www.webproworld.com/webmaster-forum/threads/117356-So-Who-wants-the-Google-Scoop-of-the-year">speculation</a> going around that Google is using data from the comment spam filter <a href="http://akismet.com/">Akismet</a> to penalize web sites. Those rumors are untrue, Google says.</p>
<p>&#8220;We don&#8217;t use Akismet to flag spam,&#8221; a Google spokesperson told us, after talking with Google&#8217;s spam team.</p>
<p>One oddity in the speculation was this:</p>
<blockquote>She stated that Google had left a client of hers the dreaded unnatural linking notice in GWT, with example urls of pages it found unnatural links on. This part is nothing new really, but until now we had no idea how Google was deciding this&#8230;</blockquote>
<p>Google&#8217;s warning notices, such as those <a href="http://searchengineland.com/google-warning-more-about-bad-link-networks-117079">that have increased recently</a>, don&#8217;t list actual URLs. We&#8217;ve reconfirmed this with Google. Instead, they&#8217;re a general message like this:</p>
<blockquote>We’ve detected that some of your site’s pages may be using techniques that are outside Google’s Webmaster Guidelines&#8230;.</blockquote>
<p>So it&#8217;s unclear how this person received a warning from Google about particular URLs, much less URLs that were never published on the web because they were trapped within a spam filter.</p>
<p><strong>Postscript By Danny Sullivan:</strong> The story above was updated to clarify that to our knowledge, Google doesn&#8217;t report specific URLs within its unnatural linking notices messages, which as explained makes the speculation even more speculative. But if anyone wants to pass along the actual warning received with those URLs, we&#8217;re happy to take another look.</p>
<h2>Related Articles</h2>
<ul>
<li><a title="Permanent Link to Google Eliminates Another Link Network, BuildMyRank.com – Just One Of Several?" href="http://searchengineland.com/google-eliminates-another-link-network-116513" rel="bookmark">Google Eliminates Another Link Network, BuildMyRank.com – Just One Of Several?</a></li>
<li><a title="Permanent Link to Google Sending Warnings About “Artificial” Or “Unnatural” Links" href="http://searchengineland.com/google-warning-more-about-bad-link-networks-117079" rel="bookmark">Google Sending Warnings About “Artificial” Or “Unnatural” Links</a></li>
</ul>
]]></content:encoded>
			<wfw:commentRss>http://searchengineland.com/google-no-we-don%e2%80%99t-use-akismet-to-catch-link-spam-117565/feed</wfw:commentRss>
		<slash:comments>12</slash:comments>
		</item>
		<item>
		<title>Google Sending Warnings About &#8220;Artificial&#8221; Or &#8220;Unnatural&#8221; Links</title>
		<link>http://searchengineland.com/google-warning-more-about-bad-link-networks-117079</link>
		<comments>http://searchengineland.com/google-warning-more-about-bad-link-networks-117079#comments</comments>
		<pubDate>Mon, 02 Apr 2012 13:11:24 +0000</pubDate>
		<dc:creator>Barry Schwartz</dc:creator>
				<category><![CDATA[Google: SEO]]></category>
		<category><![CDATA[Google: Webmaster Central]]></category>
		<category><![CDATA[Link Building: General]]></category>
		<category><![CDATA[Link Building: Paid Links]]></category>
		<category><![CDATA[SEO: Spamming]]></category>
		<category><![CDATA[Top News]]></category>

		<guid isPermaLink="false">http://searchengineland.com/?p=117079</guid>
		<description><![CDATA[Have you recently gotten a warning from Google about having &#8220;artificial&#8221; or &#8220;unnatural&#8221; links pointing at your site? Google says this isn’t a fresh crackdown on link networks but rather a change from bad links being &#8220;silently distrusted&#8221; to being more vocal about this type of penalty. Warnings Issued Many people have reported getting messages [...]]]></description>
			<content:encoded><![CDATA[<p><img class="size-full wp-image-108672 alignright" style="margin-top: 4px; margin-bottom: 4px; margin-left: 14px; margin-right: 14px;" title="google-penalty-square" src="http://searchengineland.com/figz/wp-content/seloads/2012/01/google-penalty-square.jpg" alt="google-penalty-square" width="140" height="135" />Have you recently gotten a warning from Google about having &#8220;artificial&#8221; or &#8220;unnatural&#8221; links pointing at your site? Google says this isn’t a fresh crackdown on link networks but rather a change from bad links being &#8220;silently distrusted&#8221; to being more vocal about this type of penalty.</p>
<h2>Warnings Issued</h2>
<p>Many people have reported getting messages from Google regarding link violations. If you scan the <a href="http://groups.google.com/a/googleproductforums.com/forum/#!forum/webmasters">Google Webmaster Help</a> forums, for instance, you will see many examples of these being posted.</p>
<p>Here is how one reads:</p>
<blockquote>Dear site owner or webmaster of &#8230;.</p>
<p>We&#8217;ve detected that some of your site&#8217;s pages may be using techniques that are outside Google&#8217;s Webmaster Guidelines.</p>
<p>Specifically, look for possibly artificial or unnatural links pointing to your site that could be intended to manipulate PageRank. Examples of unnatural linking could include buying links to pass PageRank or participating in link schemes.</p>
<p>We encourage you to make changes to your site so that it meets our quality guidelines. Once you&#8217;ve made these changes, please submit your site for reconsideration in Google&#8217;s search results.</p>
<p>If you find unnatural links to your site that you are unable to control or remove, please provide the details in your reconsideration request.</p>
<p>If you have any questions about how to resolve this issue, please see our Webmaster Help Forum for support.</p>
<p>Sincerely,</p>
<p>Google Search Quality Team</blockquote>
<h2>Links No Longer &#8220;Silently Distrusted&#8221;</h2>
<p>Last month, Google <a href="http://searchengineland.com/google-eliminates-another-link-network-116513">appeared to take action against several blog/link networks</a>. Are the messages going out because of that? Google told us no. Rather, it is that Google&#8217;s choosing to report penalties about bad linking issues more now than in the past.</p>
<p>A Google spokesperson emailed this statement:</p>
<blockquote>The majority of the increase in messages to webmasters is not due to messages about links. Rather, Google recently started sending messages to sites even for egregious or &#8220;blackhat&#8221; violations of our quality guidelines. The vast majority of the increase in messages is thus due to expanding the types of messages we send, not because of more warnings about links.</p>
<div>
<p>It is true that actions on link networks have been more visible lately, but there&#8217;s an important disclaimer to that. Google has been able to trace and take action on many types of link networks; we recently decided to make that action more visible. In the past, some links might have been silently distrusted or might not have carried as much weight. More recently, we&#8217;ve been surfacing the fact that those links aren&#8217;t helping to improve ranking or indexing.</p>
</div>
</blockquote>
<p>Earlier this year, Google said that it significantly <a href="http://searchengineland.com/google-sent-over-700000-messages-via-webmaster-tools-in-past-two-months-113807">increased the number of messages</a> they have sent through Webmaster Tools in 2012.</p>
<h3>Related Stories:</h3>
<ul>
<li><a href="http://searchengineland.com/google-eliminates-another-link-network-116513">Google Eliminates Another Link Network, BuildMyRank.com – Just One Of Several?</a></li>
<li><a href="http://searchengineland.com/official-selling-paid-links-can-hurt-your-pagerank-or-rankings-on-google-12360">Official: Selling Paid Links Can Hurt Your PageRank Or Rankings On Google</a></li>
<li><a href="http://searchengineland.com/googles-action-against-link-schemes-continues-overstock-com-and-forbes-com-latest-casualities-conductor-exits-business-65926">Google’s Action Against Paid Links Continues: Overstock &amp; Forbes Latest Casualties; Conductor Exits Brokering Business</a></li>
<li><a href="http://searchengineland.com/another-company-outed-for-paid-links-sequoia-backed-milanoo-75193">Another Company Outed for Paid Links: Sequoia-Backed Milanoo</a></li>
<li><a href="http://searchengineland.com/googles-jaw-dropping-sponsored-post-campaign-for-chrome-106348">Google’s Jaw-Dropping Sponsored Post Campaign For Chrome</a></li>
<li><a href="http://searchengineland.com/ny-times-covers-paid-link-schemes-first-j-c-penney-now-flowers-industry-76340">New York Times Continues Paid Link Outing Stories, Looks At Online Flowers Industry</a></li>
<li><a href="http://searchengineland.com/google-chromes-paid-link-penalty-now-lifted-115560">Google Chrome’s Paid Link Penalty Now Lifted</a></li>
<li><a href="http://searchengineland.com/google-sent-over-700000-messages-via-webmaster-tools-in-past-two-months-113807">Google Sent Over 700,000 Messages Via Webmaster Tools In Past Two Months</a></li>
<li><a href="http://searchengineland.com/dilbert-cartoon-caught-for-paid-links-on-google-82984">Dilbert Cartoon: Caught For Paid Links On Google</a></li>
</ul>
]]></content:encoded>
			<wfw:commentRss>http://searchengineland.com/google-warning-more-about-bad-link-networks-117079/feed</wfw:commentRss>
		<slash:comments>36</slash:comments>
		</item>
		<item>
		<title>Google Webmaster Tools Crawl Errors: How To Get Detailed Data From the API</title>
		<link>http://searchengineland.com/google-webmaster-tools-crawl-errors-how-to-get-detailed-data-from-the-api-115153</link>
		<comments>http://searchengineland.com/google-webmaster-tools-crawl-errors-how-to-get-detailed-data-from-the-api-115153#comments</comments>
		<pubDate>Sat, 17 Mar 2012 18:38:49 +0000</pubDate>
		<dc:creator>Vanessa Fox</dc:creator>
				<category><![CDATA[Features: Analysis]]></category>
		<category><![CDATA[Google: SEO]]></category>
		<category><![CDATA[Google: Webmaster Central]]></category>

		<guid isPermaLink="false">http://searchengineland.com/?p=115153</guid>
		<description><![CDATA[Earlier this week, I wrote about my disappointment that granular data (the number of URLs reported, the specifics of the errors&#8230;) was removed from Google webmaster tools. However, as I&#8217;ve been talking with Google, I&#8217;ve discovered that much of this detail is still available via the GData API. That this detail was available through the [...]]]></description>
			<content:encoded><![CDATA[<p>Earlier this week, I wrote about my disappointment that granular data (the number of URLs reported, the specifics of the errors&#8230;) was <a href="http://searchengineland.com/google-webmaster-tools-revamps-crawl-errors-but-is-it-for-the-better-114892">removed from Google webmaster tools</a>. However, as I&#8217;ve been talking with Google, I&#8217;ve discovered that much of this detail is still available via the <a href="http://code.google.com/apis/webmastertools/docs/2.0/developers_guide.html">GData API</a>. That this detail was available through the API wasn&#8217;t at all obvious to me from reading their <a href="http://googlewebmastercentral.blogspot.com/2012/03/crawl-errors-next-generation.html">blog post about the changes</a>. The post included the following:</p>
<blockquote>&#8220;For those who worry that 1000 error details plus a total aggregate count will not be enough, we’re considering adding programmatic access (an API) to allow you to download every last error you have, so please give us feedback if you need more.&#8221;</blockquote>
<p>And led me to believe that the current API would only provide access to the same data available from the downloads from the UI. But in any case, up to 100,000 URLs for each error and the details of most of what has gone missing is in fact available <a href="http://code.google.com/apis/webmastertools/">through the API now</a>, so rejoice!</p>
<p>The data is a little tricky to get to and the specifics of what&#8217;s available varies based on how you retrieve it.  Two different types of files are available that provide detail about crawl errors:</p>
<ul>
<li>A download of eight CSV files, one of which is a list of all crawl errors</li>
<li>A crawl errors feed, which enables you to programatically fetch 25 errors at a time</li>
</ul>
<p>(Thanks to <a href="https://twitter.com/#!/RyanJones/status/180005866550996992">Ryan Jones</a> and <a href="http://hackingsearch.com/">Ryan Smith</a> for help in tracking these details down.)</p>
<p>What this means is that different slices of data are available in four ways:</p>
<ul>
<li>User interface display</li>
<li>User interface-based CSV download</li>
<li>API-based download</li>
<li>API-based feed</li>
</ul>
<div>What you&#8217;re able to see about each error is different based on how you access it.</div>
<h2>CSV Download</h2>
<p>Eight CSV files are available through the API (you can download them all for a single site or for all sites in your account at once as well as just a specific CSV and a specific date range), but this support is not built into most of the available client libraries. You&#8217;ll need to build it in yourself or use the <a href="http://code.google.com/p/php-webmaster-tools-downloads/wiki/Running#Introduction">PHP client library</a> (which seems to be the only one that has support built in). The CSV files are:</p>
<ul>
<li>Top Pages</li>
<li>Top Queries</li>
<li>Crawl Errors</li>
<li>Content Errors</li>
<li>Content Keywords</li>
<li>Internal Links</li>
<li>External Links</li>
<li>Social Activity</li>
</ul>
<p>For the topic at hand, let&#8217;s dive into the crawl errors CSV. It contains the following data:</p>
<ul>
<li>Up to 100,000 URLs for each type of error (rather than the 1,000 maximum available through the download link in the UI)</li>
<li>The full list of URLs blocked by robots.txt (which is no longer available at all in the UI)</li>
<li>Specifics of &#8220;not followed&#8221; errors (the UI reports only the status code returned by the URL, while the CSV includes what the actual problem was, such as &#8220;too many redirects&#8221;)</li>
<li>Specifics site-wide server errors (the UI no longer lists the specific URLs that returned the error or the specific error)</li>
<li>Specifics about &#8220;soft 404s&#8221; (the UI doesn&#8217;t include the detail of the type of soft 404)</li>
</ul>
<p>This file does not include details on crawl error sources (but that is available through the crawl errors feed, described below).</p>
<h2>Crawl Errors Feed</h2>
<p>It appears that the <a href="http://code.google.com/apis/webmastertools/docs/2.0/reference.html#Feeds_Crawl">crawl errors feed</a> request code is built into the <a href="http://code.google.com/p/gdata-java-client/">Java</a> and <a href="http://code.google.com/p/gdata-objectivec-client/">Objective C</a> client libraries, but you&#8217;ll have to write your own code to request this if you&#8217;re using a different library. You can fetch 25 errors at a time and programmatically loop through them all. The information returned is in the following format:</p>
<pre>&lt;atom:entry&gt;
  &lt;atom:id&gt;id&lt;/atom:id&gt;
  &lt;wt:crawl-type&gt;web-crawl&lt;/wt:crawl-type&gt;
  &lt;wt:issue-type&gt;http-error&lt;/wt:issue-type&gt;
  &lt;wt:url&gt;http://example.com/dir/&lt;/wt:url&gt;
  &lt;wt:detail&gt;4xx Error&lt;/wt:detail&gt;
  &lt;wt:linked-from&gt;http://example.com&lt;/wt:linked-from&gt;
  &lt;wt:date-detected&gt;2008-11-17T01:06:10.000
  &lt;/wt:date-detected&gt;
&lt;/atom:entry&gt;</pre>
<h2></h2>
<h2>How the Data Differs</h2>
<p>Let&#8217;s take a look at some real examples at how what you get in this file differs from the UI and UI-based download.</p>
<h3>Number of Errors Shown</h3>
<p>The UI shows the total count over time, but only lists up to 1,000 URLs for each error. The API-based CSV contains up to 100,000 URLs for each type of error. However, it gives you only the current snapshot of errors and doesn&#8217;t provide a total count of each error (if more than 100,000 exist for any given one). This is the same information you can get from the API-based crawl errors feed. The UI-based CSV also only shows you the current snapshot of errors and lists only up to 1,000 URLs (the same as the UI).</p>
<p>For searchengineland.com&#8217;s &#8220;not found&#8221; errors:</p>
<ul>
<li>The UI shows that Google encountered 4,981 URLs (down from around 8,000 in December) and displays 1,000 of them, along with the corresponding response code (and the list of sources via a popup):
<a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwtapi1.png"><img class="alignnone size-large wp-image-115575" style="border-image: initial; border-width: 1px; border-color: black; border-style: solid;" title="Google webmaster tools crawl errors" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwtapi1-600x332.png" alt="Google webmaster tools crawl errors" width="600" height="332" />
</a></li>
<li>The UI-based CSV lists 1,238 of them, along with the corresponding response code:
<a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwtapi2.png"><img class="alignnone size-large wp-image-115576" style="border-image: initial; border-width: 1px; border-color: black; border-style: solid;" title="Crawl Errors Download" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwtapi2-600x52.png" alt="Crawl Errors Download" width="600" height="52" /></a></li>
<li>The API-based CSV lists 2,867 of them, along with the corresponding response code and the number of incoming links (but not the sources):
<a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwtapi3.png"><img class="alignnone size-large wp-image-115577" style="border-image: initial; border-width: 1px; border-color: black; border-style: solid;" title="Crawl Errors API CSV" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwtapi3-600x66.png" alt="Crawl Errors API CSV" width="600" height="66" /></a></li>
<li>The API-based feed presumably would provide all 4,981 URLs (in 25 URL increments), the response code, and the list of sources.</li>
</ul>
<p>I checked a site that the UI indicated had more than 100,000 of a particular error (257,065) and found that the corresponding API-based CSV file listed 100,005 of those. The UI-based CSV listed 1,999.</p>
<h3>Error Sources</h3>
<p>The UI shows error sources, but only at the individual URL level. Click a URL, then click the Linked From tab to see the list. You can&#8217;t download this list from the UI in aggregate or for an individual URL.</p>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwtapi4.png"><img class="alignnone size-large wp-image-115588" style="border-image: initial; border-width: 1px; border-color: black; border-style: solid;" title="Crawl Error Sources" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwtapi4-600x403.png" alt="Crawl Error Sources" width="600" height="403" /></a></p>
<p>The API-based CSV indicates the number of sources linking to each URL (which can be useful as you can tackle issues with URLs that have a lot of links first), but doesn&#8217;t list what those sources are.</p>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwtapi5.png"><img class="alignnone size-large wp-image-115595" title="Crawl Error Sources Count" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwtapi5-600x12.png" alt="Crawl Error Sources Count" width="600" height="12" /></a></p>
<p>The API-based feed provides details on the source for each URL. Below is an example from searchengineland.com:</p>
<pre>&lt;atom:entry&gt;
&lt;atom:id&gt;https://www.google.com/webmasters/tools/feeds/</pre>
<pre>http%3A%2F%2Fsearchengineland.com%2F/crawlissues/27&lt;/atom:id&gt;
&lt;atom:updated&gt;2012-03-19T17:18:18.907Z&lt;/atom:updated&gt;
&lt;atom:category scheme='http://schemas.google.com/g/2005#kind'
 term='http://schemas.google.com/webmasters/tools/
2007#crawl_issue_entry'/&gt;
&lt;atom:title type='text'&gt;Crawl Issue&lt;/atom:title&gt;
&lt;atom:link rel='self' type='application/atom+xml'
href='https://www.google.com/webmasters/tools/feeds/
http%3A%2F%2Fsearchengineland.com%2F/crawlissues/27'/&gt;
&lt;wt:crawl-type xmlns:wt='http://schemas.google.com/
webmasters/tools/2007'&gt;web-crawl&lt;/wt:crawl-type&gt;
&lt;wt:issue-type xmlns:wt='http://schemas.google.com/webmasters/
tools/2007'&gt;not-found&lt;/wt:issue-type&gt;
&lt;wt:url xmlns:wt='http://schemas.google.com/webmasters/
tools/2007'&gt;http://searchengineland.com/10-optimization-
secrets-to-drive-more-mobile-traffic-from-facebook-114316/
www.linkedin.com/in/brianklais&lt;/wt:url&gt;
&lt;wt:date-detected xmlns:wt='http://schemas.google.com/
webmasters/tools/2007'&gt;2012-03-17T05:58:35.000&lt;/wt:date-detected&gt;
&lt;wt:detail xmlns:wt='http://schemas.google.com/webmasters/tools/2007'&gt;
404 (Not found)&lt;/wt:detail&gt;
<strong>&lt;wt:linked-from xmlns:wt= 'http://schemas.google.com/webmasters/ tools/2007'&gt;htp://searchengineland.com/10-optimization-secrets-to- drive-more-mobile- traffic-from-facebook-114316/comment-page-1 &lt;/wt:linked-from&gt;</strong>
&lt;/atom:entry&gt;</pre>
<h3>Date of Latest Crawl</h3>
<p>As far as I can tell, this detail is available only in the UI (once you click on a URL):</p>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/firstcrawled.png"><img class="alignnone size-large wp-image-115728" style="border-image: initial; border-width: 1px; border-color: black; border-style: solid;" title="First Crawled Date" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/firstcrawled-600x228.png" alt="First Crawled Date" width="600" height="228" /></a></p>
<h3>In Sitemaps</h3>
<p>This level of detail also seems to be only available in the UI (once you click on an individual URL and then the In Sitemaps tab). This information is also available in aggregate from the Sitemaps section of the UI (but not as a download &#8212; either from the UI or from the API).</p>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/sitemap-errors.png"><img class="alignnone size-large wp-image-115729" style="border-image: initial; border-width: 1px; border-color: black; border-style: solid;" title="Sitemap URL Errors" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/sitemap-errors-600x134.png" alt="Sitemap URL Errors" width="600" height="134" /></a></p>
<h3>Not Followed Errors</h3>
<p>The UI shows the URL&#8217;s response code (such as 301), which as I noted in my earlier article, is somewhat misleading and not that useful for investigating the error. The report can be misread to mean that 301 response codes <em>are</em> errors. What this report actually provides is a list of URLs that returned either a 301 or 302 response code that Googlebot couldn&#8217;t follow due to a problem with the redirect.</p>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwtapi6.png"><img class="alignnone size-large wp-image-115599" style="border-image: initial; border-width: 1px; border-color: black; border-style: solid;" title="Google webmaster tools not followed errors" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwtapi6-600x140.png" alt="Google webmaster tools not followed errors" width="600" height="140" /></a></p>
<p>The UI-based CSV provides similar data (although not the additional details available in the UI when you click the URL).</p>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwtapi7.png"><img class="alignnone size-large wp-image-115602" title="Not Followed Download" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwtapi7-600x102.png" alt="Not Followed Download" width="600" height="102" /></a></p>
<p>The API-based CSV lists &#8220;redirect error&#8221; for these specific URLs.</p>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwtapi8.png"><img class="alignnone size-large wp-image-115612" title="Crawl Errors" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwtapi8-600x102.png" alt="Crawl Errors" width="600" height="102" /></a></p>
<p>That particular error isn&#8217;t any more helpful than the response code, but in some cases, this file lists the most specific issue (this detail is one of the pieces of data that used to display in the UI). <a href="http://support.google.com/webmasters/bin/answer.py?hl=en&amp;answer=35156">Possible values include</a>:</p>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/redirects.png"><img class="alignnone size-full wp-image-115725" title="Redirects" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/redirects.png" alt="Redirects" width="399" height="118" /></a></p>
<p>For instance, here&#8217;s a (slightly obscured) example of a URL with a &#8220;redirect URL too long&#8221; error:</p>
<p>http://www.example.org/A%20Category%20Page%0A/Www.Sample.Net</p>
<p>%0A/Topic%20Topic1%0A/A%20Category%20Page%20Topic%20Topic1
%0A/Topic%20Topic3%0A/Excercise%0A/Smoothies%0A/Topic2ix%0A/
Topic%20Trainer%0A/Topic3%20Programs%20%0A/Topic%20Assessments
%20%0A/Individual%20Or%20Group%20Topic3%20Topic1%20%0A/Topic4
%20Guidance%20%0A/Category2%20Loss%20Supervision%20%0A/Category2
%20Loss%0A/Support%20And%20Motivation%20%0A/Topic9%20Specific
%20Category4%20%0A/Cardiovascular%20Category4%20%0A/Topic9%20
Specific%20Category4%20%20%20%0A/Home%20Gym%20Selection%0A/
Home%20Gym%20Use%0A/Topic12%0A/Topic10%20Topic15%20Topic12%0A/
Workout%20Routines%0A/Category2%20Topic1%0A/Topic3%0A/Topic9%0A/
Topic11%20Topic12%0A/Lean%0A/Lean%20Category3%0A/Nutrition%0A/
Gift%20Topic13s%0A/Topic3%20And%20Wellness%0A/Category5%0A/Topic3
%20Programs%20For%20All%20Ages%20%0A/Topic%20Assessments%20%0A/
Individual%20Or%20Group%20Topic1%20%0A/Topic4%20Guidance%20%0A/
Category2%20Loss%20Supervision%20%0A/Support%20And%20Motivation
%20%20%0A/Cardio%20%0A/Topic9%20Specific%20Category4%0A/Category2
%20Topic1%0A/Category2%20Topic14%20Routines%0A/Premier%20Topic%20
Trainer%0A/Category2%20Loss%20Help%0A/Safe%20Category2%20Loss%0A/
Wellness%0A/Nutrition%0A/Category3%20Topic3%0A/Exercise%20Health%0A/
Category2%20Loss%20Product%0A/Category6ing%0A/Topic3%20Equipment%0A/
Category2%20Loss%20Supplement%0A/Loose%20Category2%0A/Health%0A/
Healthy%20Category6%0A/Fat%20Loss%0A/Category6%20Plan%0A/Online%20
Topic3%20Program%0A/Topic3%20Center%0A/Gym%20Exercise%0A/Fast%20
Category2%20Loss%0A/Lose%20Category2%20Fast%0A/6%20Topic15%20
Topic12%0A/Home%20Gym%20Equipment%0A/Gym%0A/Topic3%20Course%0A/
Topic3%20Exercise%0A/Gym%20Equipment%0A/Topic3%20Topic1%20Program%0A/
Gym%0A/Exercise%20Program%0A/Category2%20Loss%20Category6%0A/Topic%20
Topic3%0A/Exercise%0A/Sport%20And%20Topic3%0A/Topic3%20Class%0A/Topic
%20Topic3%20Trainer%0A/Topic10%20Topic15%20Exercise%0A/Health%20And%20
Topic3%0A/Topic3%20Australia%0A/Category2%20Loss%20Program%0A/Topic3%20
Trainer%0A/Topic%20Topic1%20Topic16%0A/Topic3%0A/Kick%20Topic17%0A/
6%20Topic15%0A/Category2%20Topic1%0A/Topic%20Trainers%0A/Category2%20
Loss%0A/Topic%20Trainer%0A/Home%20Gym%0A/Topic%20Topic1%0A/Category6
%0A/Quick%20Category2%20Loss%20%0A/Category2%20Loss%20Plan%0A/
Category7%20Category2%20Loss%0A/Easy%20Category2%20Loss%0A/Category2
%20Loss%20Tip%0A/Healthy%20Category2%20Loss%0A/Rapid%20Category2%20
Loss%0A/Topic8%20135%0A/Category2%201</p>
<p>An &#8220;invalid&#8221; redirect brought me to this page (which was a 302 to a 404):</p>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/invalid-redirect.png"><img class="alignnone size-full wp-image-115724" style="border-image: initial; border-width: 1px; border-color: black; border-style: solid;" title="Invalid Redirect" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/invalid-redirect.png" alt="Invalid Redirect" width="582" height="429" /></a></p>
<p>Empty redirects are those with no location information.</p>
<p>The API-based feed also provides these specifics as part of the feed.</p>
<h3>Soft 404s</h3>
<p>Gone missing from both the UI and UI-based CSV are the specifics of <a href="http://support.google.com/webmasters/bin/answer.py?hl=en&amp;answer=181708&amp;topic=1724951">soft 404s</a>.</p>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwt9.png"><img class="alignnone size-large wp-image-115622" style="border-image: initial; border-width: 1px; border-color: black; border-style: solid;" title="Soft 404s" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwt9-600x380.png" alt="Soft 404s" width="600" height="380" /></a></p>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwt10.png"><img class="alignnone size-large wp-image-115623" title="Soft 404s" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwt10-600x219.png" alt="Soft 404s" width="600" height="219" /></a></p>
<p>The API-based CSV still lists these details (as does the crawl errors feed), such as:</p>
<ul>
<li>404-like content (the page returns a 200 response code, but seems to contain contain from an error page)</li>
<li>Redirect to an error page</li>
</ul>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwt11.png"><img class="alignnone size-full wp-image-115625" title="Types of Soft 404s" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwt11.png" alt="Types of Soft 404s" width="394" height="237" /></a></p>
<p>&nbsp;</p>
<h3><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/redirecterrorpage.png"><img class="alignnone size-full wp-image-115707" title="Redirect to Error Page" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/redirecterrorpage.png" alt="Redirect to Error Page" width="388" height="146" /></a></h3>
<p>&nbsp;</p>
<h3>Site-Wide (Server) Errors</h3>
<p>With the UI overhaul, Google shows the number of site-based (vs. URL based) errors encountered over time, but not the specific URLs that triggered the errors, and has simplified the error messaging into three types: DNS, server connectivity, and robots.txt fetch. There is no corresponding download. (Google says when they encounter these types of errors, it typically means they&#8217;ll receive them for any URL on the site, since the problem is at a lower level.)</p>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwt12.png"><img class="alignnone size-large wp-image-115634" style="border-image: initial; border-width: 1px; border-color: black; border-style: solid;" title="DNS Error" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/gwt12-600x99.png" alt="DNS Error" width="600" height="99" /></a></p>
<p>There&#8217;s some interesting data to be gleaned here that&#8217;s not apparent. For instance, if you hover over the dots, you see the total number of Googlebot fetch requests per day. (Unfortunately, you can only see this graph if you Google encounters at least one site error during the reported time period and there&#8217;s no way to see this number other than hovering.)  For one site I looked at, the number of URLs crawled averaged around 250,000 per day. Then one day, 2% of requests returned a DNS error (2,866 of 152,528 requests). The following day, Googlebot made only 128 requests (all crawled successfully) and only 71 the day after that. This doesn&#8217;t match up exactly what the crawl stats report shows:</p>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/dns3.png"><img class="alignnone size-large wp-image-115687" style="border-image: initial; border-width: 1px; border-color: black; border-style: solid;" title="Crawl Stats" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/dns3-600x152.png" alt="Crawl Stats" width="600" height="152" /></a></p>
<p>Another site went from an average of 100,000 a day to 362 a day after 1% of requests returned a DNS error.</p>
<p>With the API-based CSV file and API-based crawl errors feed, you get:</p>
<ul>
<li>The URL that triggered the error</li>
<li>The specifics of the error</li>
</ul>
<h4>DNS Error</h4>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/dns-sample1.png"><img class="alignnone size-full wp-image-115720" title="Google DNS Errors" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/dns-sample1.png" alt="Google DNS Errors" width="397" height="43" /></a></p>
<h4>Server Connectivity</h4>
<h3><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/serverconnectivity.png"><img class="alignnone size-full wp-image-115721" title="Server Connectivity" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/serverconnectivity.png" alt="Server Connectivity" width="395" height="83" /></a></h3>
<h4>Robots.txt Fetch</h4>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/robotsunreachable1.png"><img class="alignnone size-full wp-image-115723" title="Robots Unreachable" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/robotsunreachable1.png" alt="Robots Unreachable" width="389" height="24" /></a></p>
<h3>Pages Blocked with Robots.txt</h3>
<p>This report is gone entirely from the UI but it&#8217;s still available (up to 100,000 URLs) from the API (both the CSV and the feed).
<a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/robots.png"><img class="alignnone size-large wp-image-115688" title="Pages Blocked By Robots.txt" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/robots-600x54.png" alt="Pages Blocked By Robots.txt" width="600" height="54" /></a></p>
<p>All in all, I&#8217;m happy to learn that most of this information is still available. It&#8217;s somewhat cumbersome and confusing that what&#8217;s available isn&#8217;t consistent across delivery mechanisms and figuring out how to access the API-based data isn&#8217;t all that straightforward. But for those power users (like me) who process this data programmatically, that Google is continuing to provide this information is great news.</p>
]]></content:encoded>
			<wfw:commentRss>http://searchengineland.com/google-webmaster-tools-crawl-errors-how-to-get-detailed-data-from-the-api-115153/feed</wfw:commentRss>
		<slash:comments>4</slash:comments>
		</item>
		<item>
		<title>Google Webmaster Tools Revamps Crawl Errors, But Is It For The Better?</title>
		<link>http://searchengineland.com/google-webmaster-tools-revamps-crawl-errors-but-is-it-for-the-better-114892</link>
		<comments>http://searchengineland.com/google-webmaster-tools-revamps-crawl-errors-but-is-it-for-the-better-114892#comments</comments>
		<pubDate>Tue, 13 Mar 2012 02:04:01 +0000</pubDate>
		<dc:creator>Vanessa Fox</dc:creator>
				<category><![CDATA[Features: Analysis]]></category>
		<category><![CDATA[Google: Webmaster Central]]></category>
		<category><![CDATA[Top News]]></category>

		<guid isPermaLink="false">http://searchengineland.com/?p=114892</guid>
		<description><![CDATA[Google has just revamped the crawl errors data available in webmaster tools. Crawl errors are issues Googlebot encountered while crawling your site, so useful stuff! I originally started this article by writing that in most cases, these changes are for the better and in only a few (really maddening) cases, useful functionality has been removed. [...]]]></description>
			<content:encoded><![CDATA[<p><a href="http://googlewebmastercentral.blogspot.com/2012/03/crawl-errors-next-generation.html">Google has just revamped the crawl errors data</a> available in webmaster tools. Crawl errors are issues Googlebot encountered while crawling your site, so useful stuff! I originally started this article by writing that in most cases, these changes are for the better and in only a few (really maddening) cases, useful functionality has been removed. But now that I&#8217;ve gone through the changes, I unfortunately need to revise my summary. This update is mostly about removing super useful data, masked by a few user interface changes. (And I hate to write that, because webmaster tools is near and dear to my heart.)</p>
<p><em><strong>Update 3/17/12:</strong>After talking with Google, I&#8217;ve learned that most of what I was disappointed to find had been removed and that I feel is useful detail for power users is in fact still available through the API! I&#8217;ve <a href="http://searchengineland.com/google-webmaster-tools-crawl-errors-how-to-get-detailed-data-from-the-api-115153">dug into the details and have written up my findings</a>. I&#8217;ve also updated this story with additional details from Google:</em></p>
<ul>
<li><em>Access denied errors include 401, 403, and 407. That some of these were showing up as &#8220;other&#8221; was a bug that has since been fixed.</em></li>
<li><em>Not followed errors are indeed URLs returned either a 301 or 302 and Googlebot had trouble crawling that redirect due to an issue.</em></li>
</ul>
<p>So what&#8217;s changed?</p>
<h2>Site vs. URL Errors</h2>
<p>Crawl errors have been organized into two categories: site errors and URL errors. Site errors are those which are likely site-wide, as opposed to URL-specific. <a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/Site-Errors-Bad.png"><img class="alignnone size-large wp-image-114903" style="border-image: initial; border-width: 1px; border-color: black; border-style: solid;" title="Google site errors" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/Site-Errors-Bad-600x229.png" alt="Google site errors" width="600" height="229" /></a></p>
<p>Site errors are categorized as:</p>
<ul>
<li><strong>DNS</strong> &#8211; These errors include things like DNS lookup timeout, domain name not found, and DNS error. (Although these specifics are no longer listed, as described more below.)</li>
<li><strong>Server Connectivity</strong> &#8211; The errors include things like network unreachable, no response, connection refused, and connection reset. (These specifics are also no longer listed.)</li>
<li><strong>Robots.txt Fetch</strong> &#8211; These errors are specific to the robots.txt file. If Googlebot receives a server error when trying to access this file, they have no way of knowing if a robots.txt file exists, and if so, what pages it blocks, so they stop the crawl until they no longer get an error when attempting to fetch it.</li>
</ul>
<div>URL errors are page-specific.</div>
<div><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/url-errors.png"><img class="alignnone size-large wp-image-114907" title="Google page-level errors" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/url-errors-600x113.png" alt="Google page-level errors" width="600" height="113" /></a></div>
<div>URL errors are categorized as:</div>
<div>
<ul>
<li><strong>Server error</strong> &#8211; These are 5xx errors (such as 503 for server maintenance)</li>
<li><strong>Soft 404</strong> &#8211; These are URLs that are detected as returning an error page but don&#8217;t return a 404 response code (they typically have a response code of 200 or 301/302). Error pages that don&#8217;t return a 404 can hurt crawl efficiency as Googlebot can end up crawling these pages instead of valid pages you want indexed. In addition, these pages can end up in search results, which is not an ideal searcher experience.</li>
<li><strong>Access denied</strong> -These are URLs that returned a 401, 403, or 407  response code. Often this simply means that the URLs prompt for a login, which is likely not an error. You may, however, want to block these URLs from crawling to improve crawl efficiency.</li>
<li><strong>Not found</strong> &#8211; Typically, these are URLs that return a 404 or 410.</li>
<li><strong>Not followed</strong> &#8211; (updated) These are URLs that triggered redirects that Googlebot had trouble crawling (for instance, because of a redirect loop). The UI lists whether the URL initially returned a 301 or 302, but doesn&#8217;t provide the details of the redirect error.</li>
<li><strong>Other</strong> &#8211; This is a catch-all that includes all other errors.</li>
</ul>
<h2>Trends Over Time</h2>
<p>Google now shows trends over the last 90 days for each error type. The daily count seems to be the aggregate count of how many URLs with that error type Google knows about, not the number crawled that particular day. As Google recrawls a URL and no longer gets the error, it&#8217;s removed from the list (and the count). In addition, Google still lists the date Googlebot first encountered the error, but now when you click the URL to see the details, you can see the last time Googlebot tried to access the URL as well.</p>
<h2>Priorities and Fixed Status</h2>
<p>Google says they are now listing URLs in priority order, based on a &#8220;multitude&#8221; of factors, including whether or not you can fix the problem, if the URL is listed in your Sitemap, if it gets a lot of traffic, and how many links it has. You can mark a URL as fixed and remove it from the list. However, once Google recrawls that page, if the error still exists, it will return to the list.</p>
<p><a href="http://searchengineland.com/figz/wp-content/seloads/2012/03/fixed.png"><img class="alignnone size-full wp-image-114920" style="border-image: initial; border-width: 1px; border-color: black; border-style: solid;" title="fixed" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/fixed.png" alt="" width="485" height="163" /></a></p>
<p>Google suggests using the Fetch as Googlebot feature to test your fix (and in fact now has a button right on the details page to do so), but since you are allowed only 500 fetches per account (not per site) each week (which I believe has increased from the previous limit), you should use this functionality judiciously.</p>
<h2>What&#8217;s Gone Missing?</h2>
<p>Unfortunately, several pieces of important functionality have been lost with this change.</p>
<ul>
<li><strong>Ability to download all crawl error sources.</strong> Previously, you could download a CSV file that listed URLs that returned an error along with the pages that linked to those URLs. You could then sort that CSV by linking source to find broken links within your site and had an easy list of sites to contact to fix links to important pages of your site. Now, the only way to access this information is to click on an individual URL to view its details, then click the Linked From tab. There seems to be no way to download this data, even at the individual URL level. <em>(<strong>Update 3/17/12:</strong> This detail is still available from the API-based crawl errors feed.)</em></li>
<li><strong>100K URLs of each type.</strong> Previously, you could download up to 100,000 URLs with each type of error. Now, both the display and download are limited to 1,000. Google says &#8220;less is more&#8221; and &#8220;there was no realistic way to view all 100,000 errors—no way to sort, search, or mark your progress.&#8221; Google is wrong. There were absolutely realistic ways to view, sort, search, and mark your progress. The CSV download made all of this easy using Excel. And more data is always better to see patterns, especially for large scale sites with multiple servers, content management systems, and page templates. A lot has been lost here.  <em>(<strong>Update 3/17/12:</strong> 100k URLs for each error is still available from the API-based crawl errors feed and API-based CSV download.)</em></li>
<li><strong>Redirect errors</strong> &#8211; Inexplicably, the &#8220;not followed&#8221; errors no longer seem to list errors like redirect loop and too many redirects. Instead it simply lists the response code returned (301 or 302). This seems weird to me (not to mention extraordinarily less useful) as 301s are followed just fine and typically aren&#8217;t an error at all (and 302s are only sometimes problematic), but all the redirect errors that used to be listed are critical to know about and fix. Listing URLs that return a 301 status code as &#8220;not followed&#8221; is misleading and alarming for no reason. And if this list of URLs is actually those with redirect errors, then omitting what that error is (such as too many redirects) makes this data incredibly non-useful.  <em>(<strong>Update 3/17/12:</strong> Confirmed with Google that is a list of URLs that return either a 301 or 302 that subsequently Googlebot is unable to crawl. The specific issue is still available from the API-based crawl errors feed and API-based CSV download.)</em></li>
<li><strong>Specifics about soft 404s.</strong> The soft 404 report used to specify whether the URLs listed returned a 200 status code or redirected to an error page. But the status code column appears to be empty now.  <em>(<strong>Update 3/17/12:</strong> This detail is still available from the API-based crawl errors feed and API-based CSV download.)</em></li>
<li><strong>URLs blocked by robots.txt .</strong> Google says they removed this report because &#8220;while these can sometimes be useful for diagnosing a problem with your robots.txt file, they are frequently pages you<em>intentionally</em> blocked&#8221;. They say that similar information will soon be available in the crawler access section of webmaster tools. Why remove data you&#8217;re planning to replace before replacing it? Couldn&#8217;t they have just moved this report to the crawler access section? I get the feeling that they won&#8217;t be replacing this report as is, but providing less granular data in its place. While it&#8217;s true that this report didn&#8217;t list errors necessarily, it was very useful. You could skim the CSV to see if any sections of pages you expected to be indexed were blocked. And it was critical for diagnosis. Why aren&#8217;t certain pages indexed? You could check this report before spending extensive time debugging the issue. But now you can&#8217;t do either of those things. <em>(<strong>Update 3/17/12:</strong> This report is still available from the API-based crawl errors feed and API-based CSV download.)</em></li>
<li><strong>Specifics about site level errors. </strong>The previous version of these reports listed the specific problem (such as DNS lookup timeout or domain name not found). That was very helpful in digging into what was going on. Now, you only get the count for the general category, not the specifics of what kind of error it was within that category. <em>(<strong>Update 3/17/12:</strong> This detail is still available from the API-based crawl errors feed and API-based CSV download.)</em></li>
<li><strong>Specific URLs with &#8220;site&#8221; level errors.</strong> Google says you don&#8217;t need to know the URL if the issue was at the site level. Mostly, this is likely true. But I&#8217;ve definitely encountered cases, particularly with DNS errors, that the error only happened with specific URLs, not the entire site. Knowing the URL that triggered the error would help track down issues in these cases. <em>(<strong>Update 3/17/12:</strong> This detail is still available from the API-based crawl errors feed and API-based CSV download.)</em></li>
</ul>
<p><em>(<strong>Update 3/17/12:</strong> I got lots of additional detail form Google and as noted above, am happy to report that I was at least partially wrong &#8212; most of this data is still available through the API. Power users who want this level of detail are likely to prefer the API anyway, so my disappoint has lessened.)</em></p>
<p>As for my comment in the earlier version of this story where I said that &#8220;I get the sense that many of these recent changes are designed to make the data easier for small site owners to use, and don&#8217;t really have the large enterprise-level site (or agency) in mind. For these latter organizations, more data is better, as we have systems to parse and crunch the data&#8221;, Google has told me:</p>
<blockquote>&#8220;Our strategy for Webmaster Tools is to improve the web interface and provide important, actionable, and useful information. Our changes are designed to improve the experience for all of our users, including power users. For example, we made changes to have crawl errors going back 90 days and to show the full aggregate count of URL errors instead of just the previous 100,000 cap. Power users can still access the firehose of data through our original GData API. One of the improvements we made is to now display the full count of URL errors, and that should help give more accurate data to larger sites. For example, previously if one site has over 35 million Not Found errors, that number would have been capped and shown as 100,000 errors. Now, that site can see the new number and even see where the increase happened in the historical data. We think that&#8217;s a big improvement.&#8221;</blockquote>
<p>The point about the total number of errors shown is certainly a good one. Very large sites are likely to have more than 100k errors, and knowing the significance of the problem is helpful in prioritizing.</p>
<p>Of course, in part, I&#8217;m sad to see features that I worked hard on launching when I was product manager for webmaster central be dismantled and made less useful. But mostly, as a frequent user of the product, I don&#8217;t want to lose useful functionality. <em><strong>Update 3/17/12:</strong> As noted above, I&#8217;m happy that a lot of this functionality is still available through the API. Read on to my <a href="http://searchengineland.com/google-webmaster-tools-crawl-errors-how-to-get-detailed-data-from-the-api-115153">dive into how to access these details through the API</a>.</em></p>
</div>
]]></content:encoded>
			<wfw:commentRss>http://searchengineland.com/google-webmaster-tools-revamps-crawl-errors-but-is-it-for-the-better-114892/feed</wfw:commentRss>
		<slash:comments>9</slash:comments>
		</item>
		<item>
		<title>Google Webmaster Tools Finally Adds User Administration</title>
		<link>http://searchengineland.com/google-webmaster-tools-finally-adds-user-administration-113865</link>
		<comments>http://searchengineland.com/google-webmaster-tools-finally-adds-user-administration-113865#comments</comments>
		<pubDate>Tue, 06 Mar 2012 14:24:32 +0000</pubDate>
		<dc:creator>Barry Schwartz</dc:creator>
				<category><![CDATA[Google: Webmaster Central]]></category>
		<category><![CDATA[Top News]]></category>

		<guid isPermaLink="false">http://searchengineland.com/?p=113865</guid>
		<description><![CDATA[One of the most sought after features in Google Webmaster Tools was to easily give third-party people access to your Google Webmaster Tools account without giving over your own username and password and without giving them full control of your site. Google has finally satisfied this request by adding user administration to Google Webmaster Tools. [...]]]></description>
			<content:encoded><![CDATA[<p><img class="alignright size-full wp-image-113866" title="march-2012-google-report-14833" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/march-2012-google-report-148331.gif" alt="" width="167" height="141" />One of the most sought after features in Google Webmaster Tools was to easily give third-party people access to your Google Webmaster Tools account without giving over your own username and password and without giving them full control of your site.</p>
<p>Google has finally satisfied this request by <a href="http://googlewebmastercentral.blogspot.com/2012/03/safely-share-access-to-your-site-in.html">adding</a> user administration to Google Webmaster Tools.</p>
<p>Now, site owners, who are defined as an owner if they go through the <a href="http://support.google.com/webmasters/bin/answer.py?hl=en&amp;answer=35179">verification process</a> in Google Webmaster Tools, can add access for others without making them go through the verification process. The access granted is either &#8220;owner,&#8221; &#8220;full&#8221; or &#8220;restricted&#8221; access.</p>
<ul>
<li><strong>Owner Access</strong> &#8211; Anyone who has verified the site in Webmaster Tools. This enabled them to add users via the user administration, delete sites, and more super controls.</li>
<li><strong>Full Access</strong> &#8211; Granting a user &#8220;Full&#8221; permission means that they will be able to view all data and take most actions, such as changing site settings or demoting sitelinks.</li>
<li><strong>Restricted Access</strong> &#8211; When a user&#8217;s permission is set to &#8220;Restricted&#8221; they will only have access to view most data, and can take some actions such as using Fetch as Googlebot and configuring message forwarding for their account.</li>
</ul>
<p>You can add users either on the overview page where it says &#8220;manage site&#8221; and then by clicking on &#8220;Add or remove users&#8221; or under the &#8220;site configuration&#8221; section where it says &#8220;user administration.&#8221;</p>
<p><img class="alignnone size-large wp-image-113867" title="user-administration" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/user-administration-600x349.png" alt="" width="600" height="349" /></p>
<p>Those with restricted access will see this label when accessing the tool:</p>
<p><img class="alignnone size-large wp-image-113868" title="dashboard-restricted" src="http://searchengineland.com/figz/wp-content/seloads/2012/03/dashboard-restricted-600x137.png" alt="" width="600" height="137" /></p>
<p>For more details on the access rights based on permission, see this <a href="http://support.google.com/webmasters/bin/answer.py?hl=en&amp;answer=2451999">help document</a>.</p>
<h3>Related Stories:</h3>
<ul>
<li><a href="http://searchengineland.com/google-sent-over-700000-messages-via-webmaster-tools-in-past-two-months-113807">Google Sent Over 700,000 Messages Via Webmaster Tools In Past Two Months</a></li>
<li><a href="http://searchengineland.com/google-recommending-new-video-schema-org-markup-112429">Google Recommending New Video Schema.org Markup</a></li>
<li><a href="http://searchengineland.com/now-test-your-sitemaps-before-submitting-them-to-google-109363">Now Test Your Sitemaps Before Submitting Them To Google</a></li>
<li><a href="http://searchengineland.com/google-panda-3-2-update-confirmed-109321">Google Panda 3.2 Update Confirmed</a></li>
<li><a href="http://searchengineland.com/google-changes-definition-of-average-search-ranking-position-109289">Google Changes Definition Of Average Search Ranking Position</a></li>
<li><a href="http://searchengineland.com/google-revamps-submit-content-page-109282">Google Revamps Submit Content Page</a></li>
<li><a href="http://searchengineland.com/google-webmaster-tools-adds-useful-download-options-108684">Google Webmaster Tools Adds Useful Download Options</a></li>
</ul>
]]></content:encoded>
			<wfw:commentRss>http://searchengineland.com/google-webmaster-tools-finally-adds-user-administration-113865/feed</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
	</channel>
</rss>

<!-- Dynamic page generated in 0.457 seconds. -->
<!-- Cached page generated by WP-Super-Cache on 2012-05-25 20:11:00 -->
<!-- Compression = gzip -->
