• TmWe

    Sounds quite like the ‘Super Seo Unblockable Website Scraping & Ddos Tool’ that I keep getting sales emails for.

  • http://www.seo-theory.com/ Michael Martinez

    Just what we need: More Crawl Spam techniques for the mindless SEO industry to abuse. Not a good article at all, my friend.

  • http://twitter.com/TomSchmitz Thomas M. Schmitz

    The practicing SEO understands web page retrieval is required to undertake certain projects. When activities becomes formulaic and repetitive, automation makes sense, which is why tools like Screaming Frog are well received. I doubt I’ve opened the floodgate, let alone cracked the levy.

  • http://www.seo-theory.com/ Michael Martinez

    You’re contributing to the problem by encouraging it and excusing yourself from taking responsibility. Bad SEO is bad SEO and all this link checking crap is the worst-possible SEO. No one needs to grab all these pages from Websites. That’s inexcusable, irresponsible, and completely unethical. “Let’s just pile more bad practices on top of others because of Penguin” doesn’t cut the mustard. Crawl Spam has to stop. NO MORE EXCUSES.