Hmmmm, I mostly agree. Except I think our definitions of difficult are different. People are complaining about how hard it is to move out of the Bay Area, which they can't afford to live in. Imagine how much more difficult it would be to move millions of people so they can live closer to food sources. Those people also need jobs so they can afford food, and it's hard or impossible to move industries that are capital intensive or depend on natural resources.
It's pretty obvious that eventually we'll have to deal with these problems, but I don't see how society will start the process voluntarily. It's too disruptive and there is no financial incentive to do so. (And even if one country decides to, then they lose out relative to every country that decides not to, so it really has to be an everyone or no one thing).