Who is "we" here?
> if this goes on where are we going to be in 10 years? No personal communication at all anymore because it might make somebody feel anxious and I can only have a personal discussion with them if I send a week before a full agenda and rundown?
I don't think it's about sending an agenda before or even planning, it's about avoiding creating unnecessary tension. Instead of "you have a sec?", you can say "you have a sec to talk about <subject>?". This will take you a few seconds more. And this will make a lot of people answer you quicker, with a clearer response. I understand that it's not easy to change your habits, but this seems like a win-win situation.