Who wants to know? This is a question easily overlooked, but is crucial to observation (aka surveillance). Observation is done by an observer and done with intent. Without intent, we stop looking.
I for one don't want to know or care for petty details about my neighbors. I want safety without the chore of maintaining knowledge. This might be too much to ask by 2020, but by 3000 we should have it figured out (granted we'll still here).