What you are saying is that the primary driver of price is ability to pay. This is basically a claim that the market isn't competitive at all. That's a fairly strong thing to say, as even a vastly under-supplied market can be competitive.
I don't understand how prices in a vastly under-supplied free market will not rise until they reach the maximum price buyers are willing to pay.
"Willingness to pay" is different from "ability to pay" -- your willingness to pay will be greatly affected by the price of competitors or neighboring markets, for example.
What competitors? What neighbouring markets?
Right, if there's no competitors or neighbouring markets, then you have a monopoly situation, and the sole seller (or cartel) are free to set prices as high as people are able to pay. But just because there is a shortage doesn't mean there's a monopoly.
If it's what people see, it's what people see. I've definitely seen effects like that in real-estate markets.