You've used the memory metaphor a couple times, but I'm not sure it's fitting. There's a significant difference between memory (for most people) and a camera that's always on. Yes, it would be absurd to toss someone in jail because s/he happened to remember the license plate of some parked car. But that person didn't go to great lengths to set up an elaborate, distributed recording system. Those are different things.
As to my original question, I'm still curious how you'd feel. What if it were facial recognition on public sidewalks and parks, and not license plates? Would you feel differently?