Those are all risks that come with using Bitcoin. I'm sure with time we'll see lots of improvements. For now a good way to store coins is by using paper wallets: http://www.bitaddress.org/ -you can print them yourself using any printer. Some say your keys shouldn't even be on any computer until you're ready to use them.
But for the rest Bitcoin is like cash. You lose the key you lose the cash.