I think a lot of smart or upper middle class people would still want to live near other smart or upper middle class people even if jobs were remote.

Humans are social animals and I think it's common for people in privileged positions to want to associate with others like themselves.