The majority is more afraid of what will happen if the government does not find the information to catch the person trying to hurt them, than they are about the government finding information about them and hurting them with it.
Remember it is majority rules. Not even 80/20 but 51/49. You only need 51 percent of people to have less to hide. And people in the majority are typically not the ones that have things to hide for legitimate reasons. It is the people in the minority that are innocent of any wrongdoing , but be undesirable for some reason, that have something to fear.