> They want to keep out the poors

That's classism. Indirectly associated with racism in this country, sure. But naming the thing accurately communicates the full breadth of it's effect.