Bing introduces penalty for ‘inorganic site structure’ violations
It includes penalties for subdomain leasing, doorway content and sites involved in private blog networks.
Topic: Web crawler
Screaming Frog releases SEO Spider version 12.0
The update adds PageSpeed Insights API integration and auto-saves.
Crawl data analysis of 2 billion links from 90 million domains offer glimpse into today’s web
Data analysis reveals the distribution of PageRank is highly right-skewed meaning the majority of hosts have very low PageRank.
Bing launches content submission pilot
Bing is testing a feature to let some publishers not just submit URLs to the search engine but also submit content and images.
Bingbot goes evergreen
Bing will adopt Chromium-based Edge browser to run JavaScript and render pages.
Google to update GoogleBot’s user agent
Make sure you are prepared for the new GoogleBot user agent, which launches this December.
What really matters in Google’s nofollow changes? SEOs ask
Who benefits, who will implement the new attributes and how much change should sites expect?
Google to treat nofollow link attribute as a ‘hint’
Google is also adding two new link attributes, one for sponsored links and one for user generated content links.
You can’t opt into or out of mobile-first indexing
Google's John Mueller reminds us that one day, there will only be mobile-first indexing.
Google testing tools now support evergreen Googlebot
After three months, the Google testing tools are now using the latest version of Googlebot.
How to measure success with JavaScript-dependent websites
SEO strategist Robin Rozhon answers questions from SMX Advanced about monitoring rendering success, using external A/B testing tools and more.
Google posts draft to formalize Robots Exclusion Protocol Specification
Google open sources its robots.txt parser as part of this announcement.
Google Search Console adds mobile-first indexing features
Google adds the date your site switched over to mobile-first indexing to Search Console reports.
Bing now supports batch mode for submitting URLs to Bing
You can now use a single Bing API request to submit up to 500 URLs, instead of making 500 individual API requests.
Google’s indexing issue is now resolved – new content being indexed
Google has fixed the issue with getting new and fresh content into their index.
Google’s web crawler Googlebot now runs on the latest version of Chromium: Why that’s a good thing
Googlebot has been upgraded and should now be able to crawl more modern web sites with less of an issue.
4% of the Google index hit by de-indexing bug, Moz data shows
Now that the Google de-indexing issue is resolved, how bad was it?
Botify founder: Half of enterprise pages not being crawled by search engines
The company hopes its the $20 million it just picked up in series B will bolster its platform to tackle today's "complex" SEO climate.
The technical SEO hierarchy of needs
Use the hierarchy of your site's technical SEO needs to understand its technical growth and actualization—and what to do next to improve it.
How Google will shift resources to media search and other tidbits from Gary Illyes’ AMA on Reddit
The Google webmaster trends analyst also touched on topics like the possibility of an Indexing API, whether internal over-linking penalties exist and how the clustering of duplicate pages works.
Bing lets webmasters submit 10,000 URLs per day through Webmaster Tools
How about a 1000x increase in the number of URLs you can submit to Bing in a day?
4 building blocks to help your brand’s SEO strategy succeed
Crawlability, optimization, brand engagement and knowledge-content creation are all important pieces to create a more competitive SEO program.
Robots.txt tip from Bing: Include all relevant directives if you have a Bingbot section
Pay close attention to the directives you give to Bingbot and other search engines in your robots.txt files.
Google’s Mueller spent New Year’s helping SEOs tackle hacked content, slow website issues
Google is helping webmasters and SEOs on New Years and other holidays.
Google search now supports live streams with Indexing API, structured data
Do you live stream video content? Here is a new way to get more exposure for that content in Google Search and Google Assistant.
Bing crawling, indexing and rendering: A step-by-step on how it works
Crawlers are technical but understandable thanks to Microsoft's Senior Program Manager Frédéric Dubut's presentation at SMX East.
How to boost search rankings using only your internal linking strategy
Three examples of site architecture modifications that offer big SEO gains in digital marketing.
Bing resolves backlog with its Webmaster Tools URL submission tool
Spammers went from the public Bing URL submission tool to the authenticated version, causing a backlog of URLs that needed to be processed.
Google fixes the cache 404 issue with mobile-first indexing
After several months, Google has fixed the bug that caused the cache page to fail to load.
SearchCap: The open marketing cloud, Bing improves web crawler efficiency, more
Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: The Open Marketing Cloud: A no-BS demo of Mautic’s marketing automation platform Oct 17, 2018 by Digital Marketing Depot Are you unhappy with your experience or results using one of the […]
Bing says it is improving web crawler efficiency
Bing is working on making sure its crawler doesn't miss new content and at the same time overload your web servers.
Google publishes documentation on dynamic rendering for crawling, indexing JavaScript webpages
Do you manage a high intensity JavaScript based site that is having issues in Google? Dynamic rendering may be your workaround solution.
Ask the SMXperts — Page speed, site migrations and crawling
Our SMXperts share their tactical insights on optimizing crawl budgets, fine-tuning page speed and how to execute on large-scale error-free site migrations.
SEO Toolkit
This DIY SEO Toolkit is full of free SEO tools to get you started with search engine optimisation. It doesn’t include every tool out there, simply what you need to get on with SEO without paying a penny. I have used and personally recommend every single one of the SEO tools listed below. All of […]
Technical SEO
Technical SEO was the very first type of SEO. It used to simply mean making a website in a way that Google’s spiders can read it properly. It now means anything which involved working on the infrastructure of a site. Sitemaps The way to do make sure that Google can crawl your whole site […]
How Search Engines Learn What’s On Every Page
Spiders. The terrifying answer to how search engines know what is happening all over the internet all the time is that they have an army of millions of spiders. The internet is positively covered in spiders making their way into every nook and cranny and reporting back to their masters on what they find. The […]
5 ways to improve ROI on seasonal pages by optimizing your SEO crawl budget
Guide Google to pages you want to rank, index them faster and keep them updated. Bring seasonal pages into focus to increase impressions.
Ask an SMXpert — Advanced Technical SEO for Bing
SMXpert and Microsoft Senior Program Manager Frederic Dubut answers questions on how Bing handles redirects, crawl budgets and more.
Google to stop supporting public URL submissions to its search index
Google's public form to submit new URLs to Google is going away
Google launches Indexing API for job posting URLs
Check out the new Google Indexing API. Will the uses for this API eventually be expanded or will it always be reserved for job search only?