Why would you expect a city to remain affordable forever? Like if my grandparents bought a home in lower Manhattan I should be able to too?

Cities come and go in desirability and some stay very desirable. Some cities undergo a transformation from swaths of single family homes to nothing but condo towers that cost more than homes.