Robots.txt Recruiter: Daily Mail Uses Robots.txt File To Find SEO

Malcolm Coles spotted that the Daily Mail, one of the UK’s largest papers, changed their robots.txt file to include a line which reads:

# August 12th, MailOnline are looking for a talented SEO Manager so if you found this then you’re the kind of techie we need!
# Send your CV to holly dot ward at mailonline dot co dot uk

How clever! They suspect some of the best SEOs out there would be sniffing around their robots.txt file and used it to recruit a new SEO manger. If anything, it is getting the word out there via the press that they are looking for a new SEO.

This reminds me of when Google added the User-agent: zombies Disallow: /brains to their robots.txt file on Halloween. Also, in 2006, Brett Tabke used his robots.txt file as his blog for a period of time.

I do not believe anyone every used it to hire an SEO before.

Related Topics: Channel: SEO | SEM Industry: General | SEO: Blocking Spiders


About The Author: is Search Engine Land's News Editor and owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics. Barry's personal blog is named Cartoon Barry and he can be followed on Twitter here. For more background information on Barry, see his full bio over here.

Connect with the author via: Email | Twitter | Google+ | LinkedIn


Get all the top search stories emailed daily!  


Other ways to share:

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. Comments may also be removed if they are posted from anonymous accounts. You can read more about our comments policy here.
  • Adam Audette

    I think Zappos has them one better. Here’s what we’ve been using in the header response for a year or so (see the X-Recruiting line….):

    %curl -I

    HTTP/1.1 200 OK
    Server: nginx/0.8.34
    Content-Type: text/html;charset=ISO-8859-1
    Last-Modified: Thu, 08 Jul 2010 01:11:30 GMT
    X-Core-Value: 3. Create Fun and A Little Weirdness
    X-Recruiting: If you’re reading this, maybe you should be working at Zappos instead. Check out
    Cache-Control: max-age=3410
    Date: Tue, 24 Aug 2010 21:42:37 GMT
    Connection: keep-alive

Get Our News, Everywhere!

Daily Email:

Follow Search Engine Land on Twitter @sengineland Like Search Engine Land on Facebook Follow Search Engine Land on Google+ Get the Search Engine Land Feed Connect with Search Engine Land on LinkedIn Check out our Tumblr! See us on Pinterest


Click to watch SMX conference video

Join us at one of our SMX or MarTech events:

United States


Australia & China

Learn more about: SMX | MarTech

Free Daily Search News Recap!

SearchCap is a once-per-day newsletter update - sign up below and get the news delivered to you!



Search Engine Land Periodic Table of SEO Success Factors

Get Your Copy
Read The Full SEO Guide