The point is that you don't need a bank/exchange/middleman with bitcoin. You just need the wallet key and password. Bitcoin can be stored on a post-it note.
Yeah. Just like with cash.
My point is I would rather have a team of people paid to make sure that post-it note doesn't get lost than try to keep it myself.