Should multilingual websites add English pages for AI visibility?
New research shows ChatGPT strongly favors English pages, unlike Google AI and Copilot. Here's what that means for your site.
Topic: Common Crawl
Content repurposing map for better SEO and LLM visibility
Learn how to repurpose content, discover which formats LLMs prefer, and get our content repurposing map to boost SEO and AI search performance.
Publishers push Common Crawl to stop collecting content for AI training
Could AI lose a key source of training data? Major publishers want Common Crawl to stop collecting and sharing their content.
Nearly half of online articles are now AI-generated: Study
Study of 55,000 webpages finds AI-written content surged after ChatGPT and now accounts for about half of sampled articles.
Your managed WordPress might be blocking AI bots and you can’t see it
Your SEO tools show nothing wrong. But platform-level limits may be quietly blocking AI systems from accessing and citing your content.
How AI search defines market relevance beyond hreflang
Explore how AI evaluates content across markets, and what signals help your local pages get selected, cited, and used.
Why AI optimization is just long-tail SEO done right
LLMs still rely on search, shifting SEO from head terms to the long tail. Here’s how to use AI to uncover real customer questions and win.
What the AI Visibility Index tells us about LLMs & search
Discover how LLM visibility is reshaping SEO. Learn to track brand mentions in AI responses, new metrics beyond rankings, and optimization strategies for 2025.
Optimizing for AI: How search engines power ChatGPT, Gemini and more
AI models pull from search results to build answers. Here’s how to ensure your content is among what Gemini, ChatGPT, and others surface.
Dave Davies on LLM content SEO shortcuts, attribution loss, and agentic AI
SMX Advanced keynote speaker Dave Davies shares insights on LLM pitfalls, weird tech gotchas, and why generative engines are the future.
12 new KPIs for the generative AI search era
We’ve spent years tracking clicks and rankings. But in the age of LLMs and AI search, are we still measuring what matters?
How to optimize your 2025 content strategy for AI-powered SERPs and LLMs
The future of SEO is about mentions, authority, and AI relevance. Here’s how to secure brand visibility in AI-generated search results.
Top 6 technical SEO action items for 2025
Prepare for 2025 with technical updates that optimize website resources, enhance visibility and boost SEO performance.
Report: Generative AI violates copyright law, rights of news publishers
News publishers are concerned that AI answers will replace Search traffic, leading to less revenue, lost jobs and other damages.
26% of the top 100 websites are now blocking GPTBot
The number of popular websites blocking ChatGPT has increased 250% in the past month. Pinterest, Indeed and more big brands now block GPTBot.
Dozens of big brands have blocked GPTBot, OpenAI’s new web crawler
At least 15% of the top 100 websites and 7% of the top 1,000 websites are blocking GPTBot, a new analysis finds.
Could Google passage indexing be leveraging BERT?
How Google leverages BERT depends on the use of the term ‘Passage Indexing’ (although it’s identified as a ranking update).
Crawl data analysis of 2 billion links from 90 million domains offer glimpse into today’s web
Data analysis reveals the distribution of PageRank is highly right-skewed meaning the majority of hosts have very low PageRank.
SearchCap: Google percentage ratings, PPC & Asia
Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Google testing ratings percentage instead of yellow ratings stars in text adsJul 11, 2016 by Ginny Marvin Attention-grabbing yellow is replaced with a light gray font. 3 common mistakes made in […]
SearchCap: The Day In Search, December 17, 2012
Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Google Maps iPhone App Gets 10 Million Downloads In Two Days Just about a week ago Google’s new Google Maps iPhone app was released and oh boy were people waiting for […]
SearchCap: The Day In Search, July 25, 2012
Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Google Antitrust “Settlement” Take Two: Not Quite Yet On the basis of statements and representations made in a Financial Times report, I wrote a post yesterday entitled “Google Strikes Antitrust Deal […]
Common Crawl Makes New Web Data Available, Launches Coding Contest
Looking to do research based on data gathered from across the web? That’s one of the purposes of Common Crawl, and the group has just released new data, as well as a contest to encourage use of that data The 2012 data, which contains 3.8 billion web documents, shows stats such as 63% of top […]
SearchCap: The Day In Search, December 24, 2009
Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: From NORAD Santa Tracker To Twitter: Santa Tracking For Christmas Eve 2009 Merry Christmas! Christmas Eve, that is, and you know what that means. Santa Claus is coming to town! How […]
Fun Stats: 28% Of Sites Use Google Analytics; 5% Have Facebook Or Twitter Links
Factual has analyzed data from 4 million web sites and provided a holiday gift for stats junkies. Did you know 5% of pages have either a Twitter or Facebook link? Or that 28% of sites run Google Analytics? Or 12% of them run Google AdSense? Now you do! The core data comes from CommonCrawl, a […]
What Site Owners, Web Developers & SEOs Should Know About The Yahoo Microsoft Deal
By now, everyone has read all about the news that Yahoo is replacing its search index with Microsoft’s Bing. In a way, it’s a great story of complete reversal, as in 2002, Microsoft didn’t have its own index and instead used Inktomi. Late that year, Yahoo! acquired Inktomi, which spurred Microsoft to start building its […]
Yahoo! Lets You “Build Your Own Search Service”
Yahoo! has just unveiled the next phase in their plan to spur search innovation by providing search-related resources to developers. The Yahoo! Build Your Own Search Service (BOSS) enables developers to access Yahoo! search results, combine them with other sources, rerank them, and define their appearance. Yahoo! says they are making BOSS available in an […]