But yeah, mostly what happens if rates go up is that you begrudgingly pay it, because most in that situation can afford it (those who have changed circumstances may not be able to, but most can).
Edit: also, the fact that mortgage holders are more sensitive to rate increases means (it is thought that) the central bank doesn't need to change rates by as much to get the same effect. If there would be widespread mortgage defaults given a certain sized rate increase, then that probably means the central bank can stop short of an increase that large.
So the problem is sort of self-limiting. Rate hikes are designed to induce financial strain, but too much isn't desirable, so central banks don't hike too much on purpose (they sometimes do by accident).