SEO: Crawling and Robots
Get the best search news, tips and resources, delivered each day.
Everything Should Not Be A Blog Post: Start Using Silos
Having trouble deciding how content should be organized on your website? Rather than put everything on your blog, columnist Patrick Stox...
How To Compile A Top-Notch Competitive Analysis For Search
In order to beat the competition in search engine rankings, you must first know what they're doing. Columnist Brian Harnish shares his tips for...
5 Ways To Crawl A Staging Server Before Important Site Changes Go Live (To Save SEO)
You can uncover many potential SEO problems with a thorough crawl of the staging environment, but what if it's not readily accessible? Columnist...
Robots.txt File Case Study: How Third-Party Directive Changes Led To Leaking URLs And Lost SEO Traffic
Columnist Glenn Gabe shares his troubleshooting process for identifying issues with robots.txt that led to a long, slow drop in traffic over...
Why Everyone Should Be Moving To HTTP/2
A Google spokesperson recently revealed that GoogleBot will soon support HTTP/2. Columnist Patrick Stox explains what this is and what it means...
Can You Now Trust Google To Crawl Ajax Sites?
On October 14, Google announced it no longer recommends the Ajax crawling scheme they published in 2009. Columnist Mark Munroe dives into the...
Study: 29% Of Sites Face Duplicate Content Issues & 80% Aren’t Using Schema.org Microdata
A new study shows that duplicate content issues still rage on, and while people are talking about Schema markup, only 20% of sites have...
Six Key Themes From “Meet The Search Engines” At SMX East
Contributor Eric Enge recaps a discussion with Gary Illyes (Google) and Duane Forrester (Bing) about the current and future state of search...
A Super Fresh Google Index? Server Errors & Rankings Impacts
Whether it's Caffeine or a separate Google update, server errors can negatively impact rankings more quickly now. Columnist Austin Blais...
Relaunching Your Site? Don’t Even Think About It Without A Solid SEO Game Plan!
Relaunching your website can have serious consequences for your search engine optimization if not planned carefully. Luckily, columnist Stephan...
SEO Disasters: Preventing The Unthinkable
Is your site suffering from a sudden drop in traffic? Columnist Mark Munroe notes that most SEO issues are preventable and shares his process...
3 Steps To Find And Block Bad Bots
Is your Web analytics data being skewed by bot visits to your site? If so, columnist Ben Goodsell has the...
Mega Menus & SEO
What are the best practices surrounding mega menu navigation elements when it comes to SEO? Columnist Chris Liversidge lays it...
7 Key Questions To Unlock Growth Opportunities In Your SEO Audits
When auditing a website's search engine optimization (SEO) efforts, it's easy to find issues that need to be addressed -- but columnist Aleyda...
Is AJAX Killing Your Crawl Budget?
Columnist Gene McKenna of Groupon discusses options for how to handle JSON files when optimizing your crawl...
Google Search Console Warnings Issued For Blocking JavaScript & CSS
Google sends mass notifications warning that blocking CSS or Javascript can result in suboptimal...
Drop In Bing? Moving To HTTPS (SNI) Would Have Caused It
Many webmasters have been pressured to switch from HTTP to HTTPS, but some are finding that this is resulting in a loss of traffic from Bing....
The Ultimate Guide To Bing Webmaster Tools
Contributor John E Lincoln has put together this comprehensive guide to getting started with Bing Webmaster...
The Latest In Advanced Technical SEO From SMX Advanced
Columnist Chris Silver Smith shares expert insights on advanced technical SEO, straight from the mouths of industry...
Used Car Sales & SEO: Two Tales Of Woe
Columnist Chris Liversidge walks through some major SEO problems plaguing two well-known second-hand car...
