I think you can find filter out all the good bots, but there is a large number of crawlers out there these days :)