Use general-purpose computer parts, with some imagination.
One simple example:
Modify the power pins (in a USB keychain drive and a dedicated USB socket, naturally) such that +5v and ground are connected backwards.
Connect a diode in such a way that should the stick ever be plugged into an ordinary USB socket, power is applied to a small piece of nichrome igniter wire (model rocket store, or cannibalize any electrical heating appliance.)
The igniter wire is wrapped around a small magnesium ribbon glued to the exposed (use nitric acid) EEPROM die.
Make sure that the package still looks like a normal USB key from the outside, and is well-sealed to avoid unsightly smoke and light (if you do not take care to do this, you may well find "endangering a law enforcement official using an illegal pyrotechnic device" or the like added to the charges against you.)
And of course none of this will help if the enemy expects it. The above is merely an example.