But of course bad people can still use extra encryption, so lack of default encryption will mostly hurt good people. This increases the amount by which the detection and conviction rate needs to improve to justify the intrusion.
I think it comes down to how willing you are to let bad people get away with their crimes vs lose your own right to privacy in a world where more and more of your private life and thoughts are stored digitally.
I know I find myself increasingly self-censoring in case what I write gets taken out of context and used against me. I have to second-guess some third party reading my emails, my private notes, etc., and I really don't like that feeling. It doesn't take long for political winds to change, and we're not long past times where people were put to death for what they wrote or who they were.