I would have slept a lot worse if people thought that I held millions in an asset that can be easily stolen by invading my home and putting my family at risk.
I would only be happy if I was very careful with not revealing who I was, ever (hard to do if a exchange gets compromised).
It helps that I have all my necessities well covered.