Yeah, that's the long and the short of it. RMS has had fantastic ideas, and I think he generally cares quite a bit about humanity, but the guy is weird, and people don't seem to be willing to put up with that brand of weird.
(You can be plenty of other sorts of weird and not be cancelled, of course, making the whole thing quite arbitrary....)