I know you're being facetious, but the answer is possibly yes, depending on your threat model.

If you have great physical security at your home and don't trust the banks (e.g. their fee schedules), it might be a safer decision.

For most people, it's not.