That one got even picked up by wired, this also contains an interview with one of their developers at the time
http://www.wired.com/epicenter/2010/08/robot-laws/
Fox News's robots.txt[2] is pretty interesting too - they deliberately block at least one article from being indexed[3]
And YouTube[4], as usual, shows some humor in the form of Flight Of The Conchords lyrics.
[1] http://twitter.com/#!/mikkohypponen/status/10344080313274777...
[2] http://www.foxnews.com/robots.txt
[3] http://www.foxnews.com//politics/2011/07/21/wynn-slams-obama...