I think it becomes most useful if you have an auto-follow back on your account and 200+ following. It starts to become difficult to get much utility from your twitter stream at that point.
I'm interested - what metrics would you want for choosing who to unfollow?