Presumably you can imagine a point at which inequality would cause the world to grind to a halt; in the extreme, let's say just one person on the whole planet owns everything that can legally be owned. If you can imagine that not being a particularly good thing, then the argument just becomes one of "how much is too much".