I think that is at least in part a highbrow post-justification, though I accept it's going to be more common among Apple pundits who need the Vision Pro to be a success but spent time deriding Google Glass.
The instinctive reason is quite different; it was about inattention and rudeness. Google "google glass rude" and you will see _plenty_ of coverage about it at the time. People don't like this stuff on other people.
I certainly reserve the right to dislike these things on a purely instinctive level. Whether or not they have to choose to take a photograph of me or not.