If you do plan on removing friends rather than using FB lists and organizing permissions based on lists, I would suggest going to http://www.facebook.com/friends/
It allows you to click X next to each friend rather than going into each individual profile to remove them.