The whole point of interest is supposed to account for that risk.
People buy cars all the time that cost a decent fraction of what a house does, and nobody bats an eye when they finance 100% (or more) of the value. And a car depreciates and moves. The bank knows where to find the collateral for a mortgage, and the value generally appreciates.