How much does Google’s new search term filtering affect ad spend transparency? Here’s how to find out

This script will show you the daily percentage of clicks going to search terms that Google doesn't report.

Chat with SearchBot

Google announced at the start of September it would reduce the visibility of search terms shown in reports for advertisers. Privacy was the reason cited by Google but advertisers quickly called the motives into question and complained about the loss of transparency into a large amount of ad spend. 

A few well respected PPC influencers weighed in on the impact of this change on Twitter.

Ultimately, what really matters is the impact on your own accounts and whether the change limits your ability to effectively optimize things.

A script to calculate how many queries are unidentified

So we at Optmyzr wrote a script to help you to see the impact for yourself.

The script pulls daily metrics for as many days back as you’d like. You can choose to focus on impressions, clicks, or cost. It pulls the data two ways:

  1. Using an account report, filtered for Ad Network Type = Search
  2. Using a search query report, also filtered for Ad Network Type = Search

It then compares the key metric, like cost, between the two reports. The account performance report should include data from all search queries, whereas the search query report now only includes data for search queries that made it past Google’s new filters.

We then use these two numbers to calculate the percentage of unidentified search queries — column D in the example below.

Image4 1
The script generates a Google Sheet with daily metrics based on the account report (column B) and the search query report (column C).

The search query report metrics in column C are lower because of Google’s search term filtering.

Finally, we plot this percentage of clicks going to unknown search terms by day, allowing you to easily see if there are any big changes coming out of the Googleplex.

Image2 1
The script from Optmyzr plots the daily percentage of unidentified search queries in a Google account.

Findings

The point of sharing this script is to make it easy for everyone to see the impact of this change on their own accounts. I’ve run it on only a handful of accounts myself, so my findings are based on a small sample set.

Here’s what I found:

  1. Impressions were already filtered a lot before Google’s announcement.
  2. The change took effect September 2, 2020, the day of Google’s announcement.
  3. There is a pronounced decrease in visibility into queries driving clicks and cost.
  4. E-commerce advertisers who use Smart Shopping campaigns saw less of a change because most search terms were already unavailable to them.

Let me illustrate the large amount of filtering that’s been happening for quite some time first. 

Here’s a chart for the level of filtering Google does when we consider impressions as the key metric.

Image1 1
Charting the daily percentage of unknown search terms by impressions.

Notice that there’s barely a noticeable difference on September 2nd. More importantly, notice that more than 70% of my impression volume comes from search terms that are not in the search query performance report. This data goes back to mid July for this chart but you can run it for a longer period of time if you’re curious.

Next, let’s look at what happened on September 2nd with clicks and cost data, the metrics advertisers are justifiably more sensitive to.

Here’s a chart going back to mid-July based on cost for an account.

Image3 1
This chart is generated by the Google Ads script and shows the percentage of an account’s metrics that are derived from searches where the search term is not reported by Google. 

It’s clear that there’s a big spike in unidentified search terms starting September 2nd. In this particular example, the percentage went from the mid twenties to around 50%. 

This means that for this particular account, we used to not know which search queries were responsible for about 20% of costs. Now with the recent change, we don’t know which queries are responsible for nearly half of our ad spend.

The script

Ready to do the analysis yourself? Just copy-and-paste this script into the script section of Google Ads.

The settings are pretty self-explanatory. Put your email address on line 8. Line 7 and 9 can also be changed but the script will run fine if you leave these as they are.

Seeing interesting results? Let me know via Twitter.


Opinions expressed in this article are those of the guest author and not necessarily Search Engine Land. Staff authors are listed here.


About the author

Frederick Vallaeys
Contributor
Frederick (“Fred”) Vallaeys was one of the first 500 employees at Google where he spent 10 years building Google Ads and teaching advertisers how to get the most out of it as the first Google AdWords Evangelist. Today he is the Cofounder and CEO of Optmyzr, a PPC management SaaS company focused on making search, shopping, and display ads easier to manage with rules, scripts, reports, audits, and more. He is a frequent guest speaker at events where he inspires organizations to be more innovative and use AI and Automation Layering to become better marketers. His latest book, Unlevel the Playing Field, follows his best-seller, Digital Marketing in an AI World.

Get the must-read newsletter for search marketers.