Linus is mean, but aware of it and actively working on it. Stallman is harmlessly weird. Wolfram thinks he's the smartest person on the planet when he's objectively not.
You are correct in that these are not the reasons they are impressive. It's the reason (in Linus and Wolframs case) they aren't particularly good people.
You should have to suffer brilliant assholes.