If Grandpa rents that apartment instead of owning it, he'd if anything stand to benefit (especially if we tax land value specifically and not the building).
And mine is that a lot of (and maybe most) 90 year olds wouldn't need to move. The ones who would be motivated to move are also largely the ones who are wealthy enough to do so.