How Big Data Changed Crime Fighting & Is Changing The Practice Of SEO

In the mid 1990’s, New York city Mayor Rudolph Giuliani introduced a technology-based crime measurement system called CompStat. The system enabled Police leadership, for the first time, to discern crime trends and respond to crime fluctuations on a neighborhood-by-neighborhood basis rather than the limited incident-by-incident view they previously had.

The system is credited with a 60% drop in major crime and has subsequently been adopted by major cities including Washington DC, Los Angeles, Baltimore, and Philadelphia. Interestingly, all that really sparked the change was the acquisition of information—trend insights into neighborhood crime patterns over time.

In the 1999 interview, “Betting on Intelligence,” CompStat creator Jack Maple outlines the fundamental principles behind CompStat:

  1. Accurate, timely intelligence clearly communicated to all.
  2. A rapid deployment that is concentrated, synchronized and focused.
  3. Effective tactics and strategies.
  4. Relentless follow-up and assessment.

A phenomenon that follows a similar arc of intelligence acquisition and process is occurring today in the natural search industry.

Shift From Limited View To Landscape View

In much the same way the NYPD moved from examining individual incidents to mapping crimes and compiling data to expose crime trends, the search industry is moving from an ‘incident by incident’ (keyword-by-keyword) view to a technology-powered ‘neighborhood by neighborhood’ (search landscape) view.

Driven by mature technology that gathers, stores and analyzes natural search data over time and allows for segmentation on a ‘neighborhood-by-neighborhood basis’, this information empowers SEO professionals to discern trends and communicate, report and act on these trends with maximum efficiency.

Specifically, technology-enabled collection and analysis of ‘big data’ in the SEO industry has enabled marketers to take a new, broad neighborhood view of their natural search landscape as opposed to the keyword by keyword perspective they were previously limited to (see screenshot below for more on how technology is enabling that view).

The new standard for search marketers as Police Chiefs of their online cities is to understand what is occurring on a holistic, global basis, thus arming themselves to respond to both opportunity and threat in their own online ‘neighborhood.’

SEO technology provides landscape view

Technology enables a landscape view over time


Rethinking The Approach In Search Marketing

Aside from making you aware of trends taking place in our industry, why does this matter to you as a Search Marketer?

For many still operating in the SERPs with a ‘pre-CompStat’ (pre-enterprise SEO technology) mindset, the approach is still an ‘incident by incident’ one. Many may not be aware that a ‘CompStat’ broad, data-driven view that empowers SEOs to be the informed Police Chief of their online city is even possible.

Others may need to actively change their thinking from that of Police Chief with an incident-by-incident view to one of a Police Chief who has clear insight into the unique segments of their city. This might include establishing similar principles as Jack Maple did for CompStat.

In SEO, these guidelines may be formed by asking yourself:

  •  Given access to natural search trend data, segmented by the unique ‘neighborhood’ topography of your online city, how would your practice of SEO change?
  •  Would you approach opportunity discovery any differently?
  •  Given your newfound ability to measure, would your willingness to try new things change?
  •  How about your approach to major projects such as a site redesign?

Technology In SEO Is The New Norm

In the late 1980s before he invented CompStat, Jack Maple manually plotted crimes across subway stations on a 55-foot-long wall map. Graduating to technology as a solution that kept track of crimes, not only by location but over time, allowed for analysis of crimes by neighborhood, effective modification of tactics, and manpower deployment with follow-up.

In a remarkably similar way, this evolution to data technology is mirrored in the search marketing world. Once tethered to expansive excel spreadsheets, search marketing teams now have access to technology that allows for tracking global natural search trends in a previously inaccessible manner.

When Mayor Giuliani launched CompStat in the late 1990’s, one can imagine that there were Police Commanders who resisted the technology, insisting on doing things the old, gut-driven way. Others may have been skeptical about the kind of impact mere ‘information’ could have on their ability to influence their neighborhoods.

But with time, they came to realize that understanding the broad, trended view on a neighborhood-by-neighborhood basis, knowing where and when to deploy resources, modify tactics or try new things is vital to operational success in their neighborhoods, and indeed, leveraging technology to gain that view is the future of their industry. The alternative, perhaps, was to be left behind.

Opinions expressed in the article are those of the guest author and not necessarily Search Engine Land.

Related Topics: Channel: Analytics | Search & Analytics


About The Author: is Director of Research at Conductor, Inc, an SEO technology company in New York, authoring insightful research on trends in the natural search industry.

Connect with the author via: Email | Twitter | Google+ | LinkedIn


Get all the top search stories emailed daily!  


Other ways to share:

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. Comments may also be removed if they are posted from anonymous accounts. You can read more about our comments policy here.
  • GambleIrma29

    like Roger answered I am inspired that a stud<!–put anything in here –>ent can make $4255 in a few weeks on the computer. have you seen this site link===>>⇛► 

  • Joseph Sanchez

    This article buzzed my imagination for ideas. Thank you

  • Eastern Eye

    i have to say just is that this article is nice and have some new thing that i have to read.

  • Liz Rodriguez

    Thank you for inspiring, great read!

  • cryptblade

    Fun article and critical thinking is great. Now let me get more critical with your analogy.

    Compstat had great intentions and worked initially. But with all things, eventually, an equilibrium is reached up on the initial shock factor that made CompStat initially effective.

    And there’s a wonderful terminology introduced to the commoner lexicon: “juking the stats”

    Well publicized by David Simon of The Wire, his stories reported on the growing common practice of fudging the stats to create the illusion of crime reduction. Rape becomes “aggravated assault” or something lesser. 

    Most recently, the jobs reports that the Obama crew likes to spew are wildly distorted with all kinds of misdirection statistics to make things appear better, causing murmurings of more gov’t juking of the stats.

    Now – if I was a smart enough and devious enough SEO, I could use Conductor data and a whole bunch of other data to create something very fanciful to prove my point. But it doesn’t mean the truth is in what I say.


Get Our News, Everywhere!

Daily Email:

Follow Search Engine Land on Twitter @sengineland Like Search Engine Land on Facebook Follow Search Engine Land on Google+ Get the Search Engine Land Feed Connect with Search Engine Land on LinkedIn Check out our Tumblr! See us on Pinterest


Click to watch SMX conference video

Join us at one of our SMX or MarTech events:

United States


Australia & China

Learn more about: SMX | MarTech

Free Daily Search News Recap!

SearchCap is a once-per-day newsletter update - sign up below and get the news delivered to you!



Search Engine Land Periodic Table of SEO Success Factors

Get Your Copy
Read The Full SEO Guide