Ubuntu allows you to set up an encrypted LVM on a whole drive with a single setting in the installer. Just grab the ISO with the alternate installer[1] and choose "use the whole disk for encrypted LVM" (or compatible) in the partitioning tool. The installer also allows for advanced configuration, like setting up swap and /tmp on partitions encrypted with one-time keys, while still making it fairly difficult to screw up.
Tails comes with preinstalled and preconfigured Tor and I2P and, what's important, with almost all other connectivity blocked. Just download it[2], verify the signatures, and put on a USB key. Right now, it's difficult to add persistent storage[3] but they're working on it. Also, as an additional precaution, physically removing the USB key will make Tails shut down and wipe memory.
[1] http://www.ubuntu.com/download/ubuntu/alternative-download#a... [2] https://tails.boum.org/index.en.html [3] https://tails.boum.org/forum/How_do_I_do_what_unetbootin_doe...