Don't blame people for not being able to see other people's perspectives. That takes very hard physical work, and when you perhaps write down the kinds of things that would be required to explore even a few divergent perspectives, most people are simply not cut out for the task.
Additionally, most people are not even cut out for the task of coming up with a credible narrative of what selfish rationality means to them. They have difficulty describing even their own interests.
Heaven forbid they have to model the rationality of others! Heaven forbid a model should have more than 3 factors in interaction!