Focing on your stress, avoiding inviting people over, it sounds like your problem is before your eyes. There will always be stress. How we see people depends mostly on how they handle it.
It placed all the burden on me, to accommodate the stressors.
This is an anti-pattern. That is my point.
Work through and past and away from the negative stress. You have a right -- and responsibility -- to do so. And you'll feel less uncomfortable around other people, when you feel like you're taking care of yourself.
(This isn't to say that resilient patterns can't help you engage with potentially stressful situations OR help you get in, chop wood, and move through tasks that aren't easily automated... just that "there will always be stress/tasks/entropy/hunger/fill-in-the-blank" doesn't seem to be a compelling reason to avoid efforts to mitigate any of them.)