With both Chrome and Firefox preventing users from running unsigned extensions at all, even with a configurable option, we are being too paranoid about extensions in my opinion, handing our decisions over to centralized organizations.
If I lost the ability to filter out shit on the web, whether it be ads, the junk YouTube displays over videos, or just things that I find visually unpleasant, I'd probably stop browsing most sites. User control is more important than anything, in my opinion.