Did you notice any patterns about what you wear / don't wear from doing this?
I do a similar approach, except it's insert freshly washed shirts into middle of closets, so anything that hits an outer edge I don't wear much, and is the best candidate for pruning.