But they also provide a level of security that nothing else can offer for that currency. They literally can print more money if they don't have enough to pay you back.
Isn't it more like you give me money, and for that privilege you shall now have to pay me more money for as long as I have your money?