Google explains the use cases for its different crawler types
There is Googlebot, special-case crawlers and user-triggered fetchers.
Barry Schwartz a Contributing Editor to Search Engine Land and a member of the programming team for SMX events. He owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics. Barry can be followed on Twitter here.
There is Googlebot, special-case crawlers and user-triggered fetchers.
Barry Schwartz | Apr 21, 2023 at 12:28 pm ETPage experience is important for your users and usability, but it never seemed all that important for rankings.
Barry Schwartz | Apr 21, 2023 at 9:50 am ETYou can use Bard to help you code up some Python scripts to automate some of your daily SEO or PPC tasks.
Barry Schwartz | Apr 21, 2023 at 9:32 am ETThis crawler is similar to Googlebot, but it will be used internally by Google teams to crawl the public web.
Barry Schwartz | Apr 20, 2023 at 8:20 am ETBard always showed multiple drafts but now those drafts are more distinct from each other, Google explained.
Barry Schwartz | Apr 19, 2023 at 5:43 pm ETGoogle does add that when it comes to page experience evaluation, it is not just page specific but can also be site-wide.
Barry Schwartz | Apr 19, 2023 at 1:27 pm ETThe Core Web Vitals and HTTPS report is staying but the mobile-friendly test is going away.
Barry Schwartz | Apr 19, 2023 at 1:13 pm ETReader Revenue Manager publishers can now measure traffic from Google Search queries and fix structured data.
Barry Schwartz | Apr 19, 2023 at 11:30 am ETThese changes come with the new shipping and return information in the Google search results.
Barry Schwartz | Apr 18, 2023 at 8:10 am ETGoogle Search Console added a report to monitor and fix the structured data required to enable this display.
Barry Schwartz | Apr 17, 2023 at 9:16 am ETProject Magi will help searchers complete transactions while incorporating search ads on the page.
Barry Schwartz | Apr 16, 2023 at 8:04 am ETBecause Google said it can detect spam faster, the company claimed that 99% of visits in Google Search were "spam-free."
Barry Schwartz | Apr 11, 2023 at 12:08 pm ETGoogle also now has a release notes document to track updates to Bard.
Barry Schwartz | Apr 10, 2023 at 8:07 pm ETAll broad match modifier keywords for search ads will now serve as broad match keywords instead of phrase match, Microsoft announced.
Barry Schwartz | Apr 4, 2023 at 7:32 am ETThis allows you to migrate destination and event goals using regex.
Barry Schwartz | Apr 4, 2023 at 6:56 am ETGoogle said Bard can better understand and respond to prompts for multi-step word and math problems. Coding is coming soon.
Barry Schwartz | Mar 31, 2023 at 12:56 pm ETGoogle also shared some states on how it fought fake reviews and content in local search.
Barry Schwartz | Mar 31, 2023 at 11:00 am ETBing Chat had ads since it launched Feb. 7. Now Microsoft says it's exploring ways to give some publishers a piece of that ad revenue.
Barry Schwartz | Mar 30, 2023 at 7:41 am ETWe asked some of the Google tracking data providers for data on the latest Google algorithm update.
Barry Schwartz | Mar 29, 2023 at 8:31 am ETGoogle's new features should give searchers more reason to trust your site, your authors and the content on your pages.
Barry Schwartz | Mar 28, 2023 at 12:51 pm ETThis March 2023 core update took 13 days to roll out. This was a fairly impactful update compared to previous core updates.
Barry Schwartz | Mar 28, 2023 at 10:41 am ETYou may see a change in the number of URLs reported in the Core Web Vitals report in Google Search Console
Barry Schwartz | Mar 28, 2023 at 7:57 am ETMake sure to rerun any scripts you have that may be missing data from the Bing Webmaster Tools API.
Barry Schwartz | Mar 28, 2023 at 7:56 am ETThis is an update to previously launched reports from last September.
Barry Schwartz | Mar 27, 2023 at 1:36 pm ETWhitespark has surveyed dozens of local SEO experts to compile what they believe are the most important ranking factors for local search.
Barry Schwartz | Mar 26, 2023 at 10:25 am ETGoogle said it will link to citations when Bard directly quote at length from a webpage.
Barry Schwartz | Mar 22, 2023 at 11:17 am ETGoogle said the new Ranking section of the Search Status dashboard will show active updates as well as history up to 2020.
Barry Schwartz | Mar 21, 2023 at 6:13 pm ETYou can sign up for the waitlist if you are based in the US or UK.
Barry Schwartz | Mar 21, 2023 at 11:03 am ETThis is powered by the DALL∙E model and is rolling out to Bing Chat.
Barry Schwartz | Mar 21, 2023 at 9:16 am ETWe are now seeing Bing Chat answers in the Bing Search results, in place of Bing Search Answers.
Barry Schwartz | Mar 20, 2023 at 9:36 am ETThis is the first Google core update of 2023 and the first in more than six months. The rollout may take up to 2 weeks to complete.
Barry Schwartz | Mar 15, 2023 at 10:37 am ETThis version promises greater accuracy and broader general knowledge and advanced reasoning.
Barry Schwartz | Mar 14, 2023 at 1:26 pm ETPlus, Bing Chat has passed 100 million daily active users.
Barry Schwartz | Mar 13, 2023 at 10:30 am ETSemrush compared the sixth release against the July 2022 version, while Rank Ranger compared it against September 2022 data.
Barry Schwartz | Mar 9, 2023 at 9:00 am ETAfter launching this design for the mobile search results last October, this is now officially live for desktop search.
Barry Schwartz | Mar 8, 2023 at 1:30 pm ETSEOs, content creators and marketers use Google Trends as part of their toolset, so this update might be useful for all of you.
Barry Schwartz | Mar 8, 2023 at 9:33 am ETThis update took 14 days to fully roll out and is now complete.
Barry Schwartz | Mar 7, 2023 at 1:19 pm ETSince 11:50am ET, Twitter has been having major issues with its services.
Barry Schwartz | Mar 6, 2023 at 12:25 pm ETNot all featured snippets will see text highlighted in blue, but many now do.
Barry Schwartz | Mar 6, 2023 at 9:42 am ETThe local pack that Google generally shows for queries with local intent has gone missing.
Barry Schwartz | Feb 28, 2023 at 11:34 am ET