What are pageviews? (How to track and improve them)
Learn what pageviews really mean, how they compare to sessions and users, and why they’re not the most important metric to focus on in your analytics.
Topic: Internet bot
Publishers want Congress to stop AI crawlers from hiding
More than 300 media executives will press lawmakers to require AI bots to identify themselves and disclose why they’re scraping sites.
A Google Ads targeting tactic that cut invalid clicks by 50%
After Google said it had already filtered suspicious activity, this unexpected approach restored campaign profitability.
Cloudflare: Bots now make up 57% of webpage requests
CEO Matthew Prince expected bots to outnumber humans by 2027. New Cloudflare data shows that the milestone has already arrived.
Why now is the time to prepare for WebMCP
AI agents are becoming a new discovery layer, and WebMCP could become the schema markup that helps them understand and use your site.
Automated traffic is growing 8x faster than human traffic: Report
Automated traffic now exceeds human activity across the web. Machines aren't just indexing or scraping it. They're actively using it.
Cloudflare CEO: Bots could overtake human web usage by 2027
Matthew Prince says AI bots could soon surpass humans, driving massive traffic surges, breaking ad models, and reshaping search.
The five infrastructure gates behind crawl, render, and index
Where do AI systems lose confidence in your content? Discovery, selection, crawling, rendering, and indexing hold the answer.
Googlebot dominates web crawling in 2025 as AI bots surge: Report
Cloudflare data shows AI crawlers exploding, publishers blocking bots, and many platforms sending little traffic back.
AI search fight: Cloudflare and Perplexity clash over crawling
Cloudflare says Perplexity evades crawl directives with stealth tactics; Perplexity calls the claims a misunderstanding – or a PR stunt.
No, llms.txt is not the ‘new meta keywords’
SEOs ignored meta keywords for good reason, but llms.txt is different. Understanding how could shape your AI visibility tomorrow.
As AI scraping surges, AI search traffic fails to follow: Report
AI bot scraping doubled from Q3 to Q4 of 2024. But the click-through rates from AI search remain abysmal – at less than 1%
Best of the SearchBot: Create 10 promotional campaigns to drive in-store purchases
A human asks Search Engine Land's ChatBot to create 10 campaigns to encourage shoppers to visit a garden center. Here's the answer.
Best of the Bot: Write a blog post on local SEO for small businesses
A human asks Search Engine Land's ChatBot to create a blog post on the importance of local SEO for small businesses. Here's the answer.
Best of the Bot: Create an SEO plan for a digital marketing agency
A human asks Search Engine Land's ChatBot to create a content marketing and SEO plan. Here's the answer.
X is launching two new tiers of Premium subscription
Elon Musk announced that one option will be more expensive but will block all ads, while the cheaper alternative will still display ads.
Best of the Bot: Write Google RSA ads for car diagnostic services
A human asks Search Engine Land's ChatBot for 15 Google RSA ad titles and descriptions. Here's the answer.
Elon Musk plans to make X (Twitter) a paid-for platform to tackle bots
'it’s the only way I can think of to combat vast armies of bots.'
Best of the Bot: Optimizing a Contact Us page for Google E-E-A-T
A human asks Search Engine Land's ChatBot what points you need to follow to make an EEAT SEO-optimized contact us page. Here's the answer.
3 ways bots and fake users are killing your search efforts
SEO and PPC leaders are impacted by the Fake Web in ways that seriously hinder the effectiveness of search marketing.
How paid marketers are fighting back against the Fake Web
Bots and fake users steal ad clicks, pollute audience targeting, and skew metrics. Paid marketers are learning to protect themselves.
SearchCap: YouTube redirects, Bing search ad growth & expanded text ads
Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: After Windows 10 bump & Yahoo deal, Microsoft’s search revenue growth looks stagnantJul 21, 2017 by Ginny Marvin Search ad revenues are growing, but the rate has been slowing. LinkedIn sessions […]
SearchCap: Google Smarter Search, Facebook Google App Indexing & Foursquare With Apple Maps
Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Foursquare Joins Apple Maps Data Sources As Company Builds Out EcosystemNov 16, 2015 by Greg Sterling Apple continues to improve its mapping product by adding new features and content, albeit often […]
Is CTR A Ranking Factor In Organic Results?
Contributor Bartosz Góralewicz shares the results of an experiment he conducted, which suggests that click-through rate (CTR) from search is not a ranking factor.
SearchCap: The Day In Search, April 13, 2011
Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Bing Number 1 Among Free iPad Apps I was updating some apps on my iPad today and saw that Bing is currently ranked #1 among free apps: Read our overview of […]
SearchCap: The Day In Search, June 28, 2010
Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Microsoft To Replace MSNBot With BingBot October 1, 2010 The Bing Search Blog announced that on October 1st, MSNBot will be renamed to BingBot. Bing has been testing a beta bot […]
Microsoft To Replace MSNBot With BingBot October 1, 2010
The Bing Search Blog announced that on October 1st, MSNBot will be renamed to BingBot. Bing has been testing a beta bot since November of last year. On October 1st, the beta label will be removed from the Bot name and it will be named BingBot. You should see the following useragent in your log […]
SearchCap: The Day In Search, April 20, 2010
Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Yahoo Announces Q1 2010 Earnings: Income Up 87% Yahoo announced (PDF) their first quarter 2010 earnings and showed a revenue increase of 1% and income increase of 87% from the first […]
SearchCap: The Day In Search, July 20, 2009
Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Google Seeks Privacy Counsel With Gov’t Ties Google Watch points out a job posting on the Google site for “Privacy Policy Counsel” based in Washington, DC. Given that Google is under […]
Bing To Ramp Up MSNBot 2’s Workload
Microsoft announced that MSNBot 2, which is currently in beta, may be ramped up a lot more and webmasters might begin to notice the new bot in their log files. The new bot has been out there since December 2008, and the useragent is just about the same as the original bot. New Bot: msnbot/2.0b […]
The Toolbar Factor: Engagement’s Role in Social Voting
Since their infancy, social news sites have been trying to stay one step ahead of social media users trying to artificially promote content to their front page. Digg.com has been the center focus for spamming and gaming in social media because a front-page promoted story equates to thousands of visitors and hundreds, or even thousands […]
From My Inbox: Some Search Tools To Check Out
After Yahoo-Microsoft madness, there’s been a bit of a lull so I’m cleaning out my inbox and wanted to mention a few items that might be of interest. Below, a way to quickly search blogs & social media sites all at once, a new video search tool, a study into automatic search queries, an awesome […]
Industry Group Proposes Eight Principles To Ensure Click Quality
The Click Quality Council, a group of online advertisers, advertising agencies and click quality monitoring firms formed to propose and help establish standards for search advertising quality, has proposed eight principles for ensuring industry-wide click quality. The principles are the result of a six month effort by independent members of the ad-hoc group to identify […]