robots.txt is simple and effective.

I do not want certain bots, especially so-called "archives" to automatically download all my content. And that's what robots.txt is for and works well.

The article is just stupid, sorry. There is not one real knowledgable argument.