I'd agree there's nuance to this. For your cherry picked scenario, no, that wouldn't affect my decision. I can accept a single person having a reduction in living standards. However, when most of Western society (I'm British, not American) is struggling to attain housing at a rate similar to the generation before, when the middle classes as a whole aren't able to become as financially secure as the generation before then it is enough to give me pause.
So ignoring any climate worries I already think things will be much harder. When you add on that it's estimated that billions will be without sufficient water in a few decades it's not hard to imagine that there will be significant problems of which I have very little confidence that we will be able to handle well as a species.
Perhaps I'm overly pessimistic. But as I say, this isn't the only factor we've taken into account, it's more a tertiary concern.