Did you watch the latest movie? It is heavily implied that the rivers had all dried up or were poisoned. The people lived near an under ground aquifer controlled by the local warlord Immortal Joe.
and it goes on - if rivers are poisoned, rain is some sort of hardcore acid pouring down. you actually want to avoid that as much as possible. so no, even for people that would be able to travel far, mountains might be a worse choice. plus, they are so deep into apocalypse, that they don't know geography beyond what they can reach by cars