As time goes on the non-gamer generations die off. The gamers grow richer and their willingness to pay increase. The new generations will probably also game.
Much as I don't play football anymore but still watch it, I also follow some games :) and so do many friends in their late 30s / 40s with families (mostly the same ones as others in the thread, like Magic: The Gathering, League of Legends, Hearthstone, etc.).
Not that I'm saying the market won't grow - on the contrary, I think it will continue to do so. It's a very small market compared to sports generally ($1 billion would barely buy you a top class sports team, let alone a network like ESPN).