Real-time games are "okay" if the game has the tech built in to the sound engine and does audio processing in a way that takes into account the position of your speakers (on head, surround, etc).
Problem is, I rarely meet a game that does (I think maybe I own one or two, but I can't remember which ones, which tells you what sort of impact those games made on me).
Being able to already have positional queues on a per sound basis is much different than downmixing 5.1. The technology isn't useless when all I want to do is watch a movie and be able to enjoy it with headphones without garbled audio.
Like I said above, you can downmix left, center, and right, and throw in a little sub, and get a stereo/headphone mix, but positional cues provided by surrounds are gone, and you can't just mix those in normally, the mix gets too confused.