If you never interacted with the residents there, how are you so sure it was so bad? Nevermind the people in the group home — on what basis did you acquire the belief that the neighbors were “relieved” not to interact with them?
Maybe you’re right and this situation was terrible for everyone. Is this arrangement required? Is it the best we can do?
I don’t think most people would choose to live a life with many common afflictions. I certainly wish my lower back didn’t hurt all the time. That doesn’t invalidate my existence, and neither does my son’s Down syndrome invalidate his.