If you look a the overhead map of Marfa, you'll see it isn't particularly land constrained. However, people living in trailer houses on small lots in town are seeing their taxes go up, so they eventually have to move. Also perversely, the land around there you see with cows or crops on it is almost assuredly in an agricultural tax exemption status, so the excess land has little pressure to be sold for new housing.

It's perverse because it effectively forces poorer people to sell to rich people.

I will also note Texas has a homestead exemption, originating in 1876, so this is a well-known issue. It does not appear to be inflation or value indexed, and does not provide relief to low-income people when their house suddenly appreciates. There is a limit on how much the appraisal goes up every year, but it's certainly more than wage growth.

Regardless, the point is OP's ideal town this is not, the people moving there are not moving for the local jobs and economy in a nice little town. The incomes certainly don't support the high house prices.