Most people are simply too lazy to run their own web crawler. I'm not sure why this is (the technology is well known), but they find the convenience of public search engines irresistible.
Of course the ruling doesn't disallow crawlers, even personal ones, to access the Post's review. It doesn't even prohibit Google from displaying the links in full, as long as the search criteria does not contain Dejan's name.
Google hardly has the right to free speech anyway. DMCA can remove links willy nilly. Even fraudulent takedown requests are processed smoothly, with little to no repercussions. It's easy to be idealistic about free speech. Yet to see the balance between people claiming harm and the people's need to know, to have seen the pendulum swung before, it's hard to get upset about this.