Search Engine Land
  • SEO
    • > All SEO
    • > What Is SEO?
    • > SEO Periodic Table
    • > Google: SEO
    • > Bing SEO
    • > Google Algorithm Updates
  • PPC
    • > All PPC
    • > What is PPC?
    • > Google Ads
    • > Microsoft Ads
    • > The Periodic Tables of PPC
  • Focuses
    • > Local
    • > Commerce
    • > Shopify SEO Guide
    • > Content
    • > Email Marketing Periodic Table
    • > Social Media Marketing
    • > Analytics
    • > Search Engine Land Awards
    • > All Focuses
  • SMX
  • Webinars
  • Intelligence Reports
  • White Papers
  • About
    • > About Search Engine Land
    • > Newsletter
    • > Third Door Media
    • > Advertise

Processing...Please wait.

Search Engine Land » Channel » SEO » SiteGround Google’s crawling and indexing issues fixed

SiteGround Google’s crawling and indexing issues fixed

After numerous days where sites hosted on SiteGround were blocking Google from indexing, the issue has been resolved this morning.

Barry Schwartz on November 12, 2021 at 9:43 am

For the past several days, 2 million or so of the domains hosted on SiteGround were potentially not being crawled and thus indexed by Google Search. There was some sort of “network issue between AWS Global Accelerator service and Google,” the company said and as of this morning, the issue was resolved.

When the issue began. Matt Tutt first reported about the issue this past Tuesday, November 9th. So the issue started sometime before November 9th, Matt suspects it started as early as Monday, November 8th.

Here is a screenshot showing how Google Search Console’s URL inspection tool was unable to access sites hosted on SiteGround. As you can see from the screenshot below, Google is reporting that it failed to crawl the page. Matt posted more debugging details on his post.

Confirmation. Then on November 10th, SiteGround confirmed the issue and said it is investigating. “We have escalated the issue to Google and we are working to troubleshoot and identify the cause of the problem,” the company said.

We have escalated the issue to Google and we are working to troubleshoot and identify the cause of the problem. We will keep you updated once there's more information or the problem is fixed.

— SiteGround (@SiteGround) November 10, 2021

The issue. On November 11th, SiteGround confirmed the issue was between Amazon Web Services and Google. The company said “we traced it down to a network issue between AWS Global Accelerator service and Google. We’re collaborating with engineers from both teams to fix it.”

Resolved. Then a day later, on November 12th, SiteGround confirmed the issue was resolved and that it can take a bit more time for DNS to update but once the update is propagated properly, Google will once again be able to crawl sites hosted on SiteGround. The company said “We are glad to inform you that we have implemented a fix for the Google bot crawling issue experienced by some sites. Websites are already being crawled successfully. Please allow a few hours for the DNS changes to take effect.”

Status Update: We are glad to inform you that we have implemented a fix for the Google bot crawling issue experienced by some sites. Websites are already being crawled successfully. Please allow a few hours for the DNS changes to take effect. Thank you for your patience!

— SiteGround (@SiteGround) November 12, 2021

Google advice. John Mueller of Google posted some advice on Twitter on how Google deals with these outages. In short, don’t worry too much, the issues you may have experience from the outage will auto correct and “settle down.” There won’t be any “lasting effects” to the outage, John added. John posted several tweets, here is the first one if you want to click on it to read through the rest.

We recently saw some sites that had DNS issues specific to Googlebot's crawling, and I thought I'd do a short thread on how that works out for Google. tl;dr: don't worry, it'll settle down, there are no lasting effects.

— ???? John ???? (@JohnMu) November 12, 2021

Why we care. If you are one of your clients are one of the two million domains hosted on SiteGround, you may have been impacted by this. That means any new or updated content or pages on your site was invisible to Google for most of the work week.

The issue is resolved and those pages should be crawled by Google going forward. But you may want to annotate your analytics and reporting if you were impacted by this crawling issue.


New on Search Engine Land

    Google search results spam for ‘Bill Slawski obituary’ shows the dark side of SEO

    New mobile Google ad experiment puts favicon in-line with display URL

    Google launches video health tools to help publisher monetization

    SEO pioneer and expert Bill Slawski passes away

    New Yelp feature: Request a Call

About The Author

Barry Schwartz
Barry Schwartz a Contributing Editor to Search Engine Land and a member of the programming team for SMX events. He owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics. Barry can be followed on Twitter here.

Related Topics

AmazonGoogle Search ConsoleGoogle: SEOSEO

Get the daily newsletter search marketers rely on.

Processing...Please wait.

See terms.

ATTEND OUR EVENTS

Learn actionable search marketing tactics that can help you drive more traffic, leads, and revenue.

March 8-9, 2022: Master Classes (virtual)

June 14-15, 2022: SMX Advanced (virtual)

November 15-16, 2022: SMX Next (virtual)

Learn More About Our SMX Events

Discover time-saving technologies and actionable tactics that can help you overcome crucial marketing challenges.

Start Discovering Now: Spring (virtual)

September 28-29, 2022: Fall (virtual)

Learn More About Our MarTech Events

Webinars

Take a Crawl, Walk, Run Approach to Multi-Channel ABM

Content Comes First: Transform Your Operations With DAM

Dominate Your Competition with Google Auction Insights and Search Intelligence

See More Webinars

Intelligence Reports

Enterprise SEO Platforms: A Marketer’s Guide

Enterprise Identity Resolution Platforms

Email Marketing Platforms: A Marketer’s Guide

Enterprise Sales Enablement Platforms: A Marketer’s Guide

Enterprise Digital Experience Platforms: A Marketer’s Guide

Enterprise Call Analytics Platforms: A Marketer’s Guide

See More Intelligence Reports

White Papers

Reputation Management For Healthcare Organizations

Unlock the App Marketing Potential of QR Codes

Realising the power of virtual events for demand generation

The Progressive Marketer’s Ultimate Events Strategy 2022 Worksheet

CMO Guide: How to Plan Smart and Pivot Fast

See More Whitepapers

Receive daily search news and analysis.

Processing...Please wait.

Topics

  • SEO
  • PPC

Our Events

  • Search Marketing Expo - SMX
  • MarTech

About

  • About Us
  • Contact
  • Privacy
  • Marketing Opportunities
  • Staff

Follow Us

  • Facebook
  • Twitter
  • LinkedIn
  • Newsletters
  • RSS
  • Youtube

© 2022 Third Door Media, Inc. All rights reserved.