"A good tinfoil hat approach is to use an iPod touch running an end-to-end encrypted messaging/calling app of your choice, connected to a secure hotspot."
Yes, but it's not much of a phone if it's WiFi only. You could use any laptop for such scenario as well.