Paid And Organic Search: Understanding The Math (And The Truth)

In last month’s column I talked about buying brand keywords and some of the great (somewhat) new ad products available to advertisers. All that talk about buying brand keywords brought me back to a familiar topic about which, if you read my post with any frequency, you just might be getting a tiny bit tired of hearing me rant. In spite of that, I’m back for one more round of discussion about the relationship between paid and organic search traffic, this time with some real math to show for myself. Bear with me, this one’s worth it.

I mentioned in my previous post about paid and organic search traffic that the goal in any analysis is to determine if the paid ad is a source of lift, cannibalization, or both. At the time I was looking at isolating the traffic from the organic listing and then quantifying the incremental effect of the paid search ad. Since then, thanks to Matthias Blume, I have seen the light, statistically speaking, and have thus found a much more elegant way to conduct this analysis. Let’s put on our statistical hats and go on a journey to the heart of the issue.

Let’s reset the situation: You rank #1 organically for your brand keyword search, and you’re trying to determine if and how much you are willing to pay for a paid ad on your brand keyword search. The goal then is to understand how the clickthrough rate (CTR) of the organic listing is affected by the presence of the paid ad. You’ll do this by looking at how the CTR of the organic listing changes with and without the presence of the paid ad. The CTR rates I am referring to need to be normalized for search volume. I’ll explain what that means below, but that was the tricky part that I didn’t get before, the elusive reality about which Matthias enlightened me.

To calculate this normalized CTR, you’ll first need to try to figure out what the search query volume is for the keyword you’re targeting. This isn’t always explicitly defined, but if you’re clever you can find some ways to approximate it with a good deal of accuracy. Some search engines provide approximate monthly search query volume for keywords, and I believe there are third party providers of approximate search query volume data as well. Ideally you will want to have search volume by day for whichever keyword you’re testing on a particular search engine. If you can’t get to this level of resolution that’s OK—just go with weekly or monthly search volume. This will mean that it will take longer to get your results.

I’m going to explain how we did our analysis, and you can make any variations you need based on your own constraints. First, we chose a few brand keywords to track. At Yahoo!, we have many brand terms to choose from: [yahoo], [yahoo mail], [yahoo finance], etc. At your company you may have a similar portfolio, or you may have only one brand keyword that really matters to your business.

Here’s how the analysis works: on day 1 of our research period, we had the organic listing in #1 position, with no paid search ads (at all) on the page. We began to collect referral data from the organic listing. After a week we started buying paid search ads for our brand terms, and began tracking referrals from the paid ad as well. From then until day 30 we bought paid search at different budget levels and turned it off for periods of time as well, just to get a variety of data points.

At the end of the research period we compiled our data and began to plot it out on a chart. The metrics that we calculated were fairly simple. On any given day, organic CTR is [referrals from the organic listing divided by search query volume], and paid search CTR is [referrals from the paid search ad divided by search query volume]. We calculated these two metrics for each day 1-30, and plotted them on a scatter graph. It looked like this:


Here the way to read this graph: On the X (horizontal) axis is the paid search CTR. On the Y (vertical) axis is the organic CTR. Each of the data points represents a day where we gathered data, and each point is plotted where the two CTRs meet on the graph (I’ve stripped the values out of the chart to protect the innocent). The line on the graph is a linear regression, basically a trend line that represents a summary of the scattered data points.

Here’s the key: If the slope of the line is positive (the line goes up and to the right) as it is here, there is positive synergy between the organic listing and the paid ad. This means that on days where we bought the paid ad, the CTR of the organic listing actually increased. If the line had a negative slope (went down and to the right), there would be negative synergy between the organic listing and the paid ad. I referred to this as cannibalism in my previous column on this topic, and it means that your paid ad is stealing traffic from your organic listing.

So in our case I ran around the building, loudly declaring victory. I mean, what could be better than buying paid search traffic knowing that you’re driving more clicks to your organic listings? Believe me, I’m not saying that it will turn out this way in every case. Do your own analysis and come to your own conclusions, because naturally it’s going to work differently for everyone. I’m just here to share my story with you, and mine happens to have a very, very happy ending.

Opinions expressed in the article are those of the guest author and not necessarily Search Engine Land.

Related Topics: Channel: SEO | Industrial Strength


About The Author: is Vice President, Marketing at Move, Inc., parent company of and other significant real estate-focused web properties. In this capacity, Roth oversees Paid and Organic Search, Affiliate, Mobile and Social Marketing for the Company. Prior to his arrival at Move, Dave was Sr. Director of Search and Affiliate Marketing at Yahoo!, Inc.

Connect with the author via: Email | Twitter | LinkedIn


Get all the top search stories emailed daily!  


Other ways to share:

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. Comments may also be removed if they are posted from anonymous accounts. You can read more about our comments policy here.
  • CD

    Sorry, I don’t buy it.

    Anyone out there a statistician? I’ve worked with many and have just enough knowledge to be skeptical.

    The problem I see with the line on the graph is that I could just as easily have averaged it a different way and drawn that line down and right. Just because the data looks like it supports a conclusion doesn’t mean it does. To me the data looks completely random, the dots plotted really don’t mean anything in relation to each other because we don’t know when they were collected and what was turned on and off at that time.

    My bet is that if this graphed showed the two variables plotted independently by day they were recorded that the results would look completely random. That’s just a guess but, I good one based on my experience.

    This could be a really interesting and valuable analysis, but I believe more statistical rigor could be applied.


  • jjmullz

    It’s the gradual budget increase for paid search ads that makes the data ‘trendable’ and gives it order – from what i can gather at least

    It seems to me that the further a point is to the left the less budget assigned to paid search listings (and of course vice versa) so this graph shows that as more budget is assigned to paid search, the CTR rises for paid search (obviously) but also, and crucially, for organic search.


  • jjmullz

    On second thoughts – that is clearly wrong – I am inclined to agree with the first comment.

    Can anyone shed more light on this?


Get Our News, Everywhere!

Daily Email:

Follow Search Engine Land on Twitter @sengineland Like Search Engine Land on Facebook Follow Search Engine Land on Google+ Get the Search Engine Land Feed Connect with Search Engine Land on LinkedIn Check out our Tumblr! See us on Pinterest


Click to watch SMX conference video

Join us at one of our SMX or MarTech events:

United States


Australia & China

Learn more about: SMX | MarTech

Free Daily Search News Recap!

SearchCap is a once-per-day newsletter update - sign up below and get the news delivered to you!



Search Engine Land Periodic Table of SEO Success Factors

Get Your Copy
Read The Full SEO Guide