The issue is not just that models are hard. The claim of some economists is that while people behave irrationally, not everyone behaves irrationally all the time, so the issue is self-correcting as long as you have enough liquidity and participants in the market.

It's like the law of large numbers; while a single transaction may have a completely wrong price, a sufficiently large number will average the irrationalities out.