I avoid being a persistent fanboy/hater toward any company, and try to consider each case on its merits. Some of the concerns regarding multiple app stores on the device (which raises issues of security, privacy, and even storage space) are valid. But they fail to address a huge problem: Apple's draconian policy on in-app purchases. If IAP were to be opened up and become more competitive, I might stick with Apple's just for security and convenience, but the alternatives would be there, and I personally wouldn't mind a lack of alternative app stores.
Edit: to clarify, I'm saying I wouldn't mind having one app store if Apple's stranglehold on IAP could be relaxed (whether by choice or by law).
Another edit: Apple could also allow one-off sideloading, but not allow an app to install other apps (i.e. become a separate app store). This would be a win-win for consumers. Assuming that's who everyone cares about, of course.