Use a USB key with everything installed on it in a portable fashion. The Tor Browser Bundle is something like this.

Two issues with this method are that TOR is 80% funded by the us government, using a computer opens you to backdoors.

But at least that's a good start.