The argument that density puts stress on people to move _towards_ that density seems to me to have the direction of causation reversed. People look at prices when they move, not density.
The _main_ reason people move ever closer to Downtowns is economic. They _have_ to do it, because that's where the high-paying jobs are.