I don't know where you are, but I think your opinion is colored by the status quo in your country. In a lot of places in Europe people do sort them, and from what I've seen they do a good job at it.
Also, sorting machines are probably not that hard, but remember that this is a low-value product. You cannot justify a lot of expense. (..unless, of course the government pays; different discussion though)