I wasn't talking about zipping up your files on a CD and putting them in a draw. There are companies like IronMountain, which give you off-site physical storage.
I am sure the deletion protection Jungle Disk provides is good but what if somebody internally deletes a S3 file or directory of files they are gone for ever. This isn't an S3 problem just a issue with the strategy.