Note the fact that I did not mention money. I mentioned wealth. Holding a huge bag of money is useless because as you stated, people can now choose to use another currency and I lose all my money, it becomes worthless. Or people can work for each other, without money.
But what if I own all the productive land? What if I own a corporation that manufactures a product you depend on? This is wealth.