As a photographer myself, how do you think street photography happens? Sometimes the mundane stuff is unstaged, and when I was shooting it, you end up throwing a lot of stuff away anyway. In North America, you have no right to privacy in a public space. I understand why people are antsy about being photographed / recorded in public, but they direct that anger at the person doing it instead of the laws that allow it.
Besides, the person you see and who is generally being intentionally visible isn't usually the one you have to worry about.