First, few of us have taken the time to read accounts of how the political groups of history have used information against people. So we don't know to do addition when we have one and one.
Combine that with the fact that most of us aren't engaged in any sort of activity that incumbent power would like to disrupt. You get a false sense of security, because no one is presently leveraging any of the information they have against you. That could change the moment you had an exciting or disruptive political idea, but for now 'the system' is happy with you keeping your head down and working.
If anyone wants to read a sad tale of how groups of men can use information to hurt each other, check out Out of the Night by Jan Valtin