Google-InspectionTool – the new Google crawler for Google testing tools
Google has added a new Google crawler to its list, this one is uses for testing tools you use in Search Console or other Google properties.
Topic: Web crawler
Google explains the use cases for its different crawler types
There is Googlebot, special-case crawlers and user-triggered fetchers.
Google launches a new crawler named GoogleOther
This crawler is similar to Googlebot, but it will be used internally by Google teams to crawl the public web.
Should you block ChatGPT’s web browser plugin from accessing your website?
It's a hot debate in SEO right now: You can block OpenAI's ChatGPT-User bot with robots.txt – but should you? Short answer: No. Here's why.
Google publishes new link best practices
This help document went from basics on crawlable links to a much more robust link best practices.
New Bingbot user-agent now fully live
After a couple years of testing, Microsoft has now stopped using the old BingBot user agent.
Microsoft to go fully live with new Bingbot user-agent change in January 2023
After a couple years of testing, Microsoft said it will stop using the old BingBot user agent next month.
Google launches new Google Search status dashboard
This report will confirm if there is an issue with crawling, indexing or serving with Google Search.
Google shut down Duplex on the Web
Google has also retired the DuplexWeb-Google web crawler.
Crawl efficacy: How to level up crawl optimization
Crawl budget is a vanity metric. Your goal should be to guide Googlebot in crawling important URLs fast once they are published or updated.
9 important features of enterprise SEO platforms
Want to grow your company's organic search visibility and revenue? These are some must-have features of an enterprise SEO platform.
The origins of E-A-T: Page content, hyperlink analysis and usage data
Discover the original sources of expertise, authoritativeness, and trustworthiness in search and what they're actually based on.
How to do a schema markup audit
This guide will walk you through the steps of a structured data markup audit and give you tips on how to do it right.
Google Search Console’s new video indexing report now rolling out
This report can give you deeper insight into indexing issues and saturation within Google Search.
Microsoft launches auto-updates for shopping campaigns
The new feature aims to help advertisers sell more products by automatically updating prices and availability.
Why 100% indexing isn’t possible, and why that’s OK
While 100% indexing may be possible in terms of 'technical,' it’s likely not going to be possible in reality.
4 technical SEO issues auditing tools won’t show you
Here are four of the top technical SEO issues that your auditing tools won't show you and how to find them.
We’ve crawled the web for 32 years: What’s changed?
A look back at the history of search and SEO and a preview of what the next iteration of the internet means for marketers.
Microsoft Bing drops anonymous sitemap submission due to spam issues
You can now only submit sitemaps to Bing using robots.txt or Bing Webmaster Tools.
Bingbot user-agent change coming in the Fall of 2022
Bing will stop using the historical user-agent and transition fully to the new user-agents.
4 technical SEO tasks that are critical to organic success
Technical SEO is a necessity. Here are four key technical tasks SEOs should take care of to help increase organic visibility.
Indexing: A tale of two search engines
In Part 7 of our Messy SEO series, we look at the differences between Bing and Google’s indexing of MarTech’s content.
Google’s URL Parameters tool is going away
Google said this is because the tool has "low value."
IndexNow integrations grow as Bing says ‘millions’ of sites are using it
Duda, All in One WordPress SEO plugin and Rank Math SEO plugin gain IndexNow support.
The benefits of dynamic rendering for SEO
Google is getting better at crawling JavaScript, but there are still limitations. At SMX Next, Nati Elimelich explained how dynamic rendering can overcome those limitations while avoiding potential cloaking issues.
URL changes are not so simple for Google Search
Making URL changes to your site can take several months for Google to process.
Shopify chat bug leads to titles with (1) in Google’s search results
The issue is resolved but it might take time for your titles to be reprocessed.
IndexNow now officially co-sharing URLs between Microsoft Bing and Yandex
Plus, you can now use api.indexnow.org's endpoint to submit URLs.
3 ways to check technical SEO health issues on your website
Technical SEO is vital to keep your website healthy. At SMX Next, Ashley Berman Hale shows how marketers can review their site's crawl stats, rendering and indexing.
Microsoft releases IndexNow plugin for WordPress
Microsoft Bing has released a plugin for WordPress to let you easily integrate the IndexNow protocol on your WordPress site.
Messy SEO: Fixing site structure while a Google title change sinks clickthroughs
In Part 5 of our Messy SEO series, we look at the results from Google's title tag changes and other SERP issues affecting MarTech.
Google confirmed serving issue with Google Search results
If you see your content not showing up in Google Search this morning, you are not alone - it is a confirmed Google bug.
Google issue sent Search Console redirect error notifications; Google will fix issue
You can safely ignore this notification if you received it over this past weekend.
When Google’s title change goes wrong
In Part 4 of our Messy SEO series, we look at how Google's SERP title change gutted one of MarTech's most important pages.
60,000 websites using Cloudflare turned on IndexNow
IndexNow is an initiative by Microsoft and Yandex to push content to search engines that launched in October 2021.
Google had a crawling issues that impacted some sites
Between November 11th and November 17th, Googlebot slowed crawling on some websites.
Microsoft list of Bingbot IP addresses released
Knowing which bot is really from Microsoft Bing and which is not can help you decide which rogue bots to block from your site.
List of Googlebot IP addresses released
Knowing which bot is really Google and which is not can help you decide which rogue bots to block from your site.
IndexNow – new initiative by Microsoft and Yandex to push content to search engines
Google seems to currently not be participating in this initiative.
E-commerce SEO guide: New documentation from Google
The new guide from Google gives e-commerce SEOs documentation they can take to clients and stakeholders to get their recommendations implemented.