This feature is one of the reasons I run CyanogenMod. You can drill down and toggle particular permissions for each app if you want, and set default policies for new apps.