Hacker News Reader

isn't this what robots.txt for? can't you block facebook?

The article mentions that they tried that and the crawler ignored it.

As the article clearly states: no

whoops, my laziness. sorry