I always thought about putting multiple tuners in the box, and just decoding multiple channels simultaneously. Then to switch a channel you would just "put another window in the front".
You could have a predictive system that would decode the three most likely next channels and start decoding them. In the best case, this would move the latency of the first switch close to zero, and of subsequent switches to 1/2 or 1/3.
To save energy, you could get one of these fancy remotes that they have for telefone conferences, that can detect when you pick it up. Once you lift the remote, start the extra tuners.