You are right, I don't know much about Torvalds. He might be a very patient person most of his life. Like any public figure, he is probably badly misrepresented on the web.
But what makes me sad is that when he does snap, there's a large number of people who come and justify his behaviour. People don't say "You are misrepresenting him!". People say "He gave so much to us. He has the right to behave this way."