It's so weird that supply and demand doesn't fix this. there's no real barrier to becoming a house builder other than learning the trade, but it's not rocket science.
And no, I'm not talking about Midtown Manhattan. Rural Maine, roughly 3 to 3.5 hours from Boston, is where I was looking and it wasn't easy to find the right spot.