That‘s not at all the case in many other legal contexts.
Clearly it's impolite to peer into your neighbours windows with binoculars, and gossip about all the conversations you overhear with your hearing aids, but you've got the right to do so, don't you?
What about observing your neighbours through a peep hole in your door (or wall)? What about setting up a camera instead of a peep hole? And what if you want to see the camera feed from your phone? Reference it for later? Where is the line? All of these, including pens and paper, are technological augmentations to our innate capabilities. I'm not against banning them per se, I'd just like a clear idea of why we ban some and not others.
Can you think of any reasons why we would want to ban some and not others? It reminds a bit of something that Emma Goldman might say: people have only as much liberty as they have the intelligence to want and the courage to take.
Say in 1000 years from now everyone has cameras and storage media implanted in their persons, I suspect the public consciousness surrounding what is and isn't expected to be recorded would change. I don't however think that your fundamental liberty as a human being should depend on the public consciousness, but rather be derived from principles/axioms.
If you avoid this question, you can justify just about any tyranny so long as it can be argued to be "beneficial" (spoiler alert: this is how the worst atrocities in history have been justified). In other words, the ends don't justify the means.