The issue is that the human rich and the poor don't exist on separate planets (yet?). One plausible theory, though one I don't argue for or against here, is that as economic power ends up concentrated in fewer and fewer hands, so does political power and the will to change the crappy situation of the poorest, despite the hand-wringing of the more civic-minded rich. This would lead to a world that many people would rank lower than a world with less poverty and more equality.
The details are everything here: if evidence supports the idea that increased inequality raises the economic floor, then we shouldn't worry too much about it. But the people arguing otherwise aren't jealous of their next door neighbor's new car in itself but are worried that, in the actually existing world, increased economic inequality inherently leads to negative social effects.
Not that expensive real estate is bad in itself, but people who work in areas where they can't afford to live - for instance, a hypothetical cop in NY / LA / SF - have three obvious choices:
1> commute, sometimes for hours one-way. One could argue that policing outside of one's neighborhood is bad policing, but for the most part, long commutes are just a drag. And probably will last only as long as it takes for a job closer to home to open up. So now it's a turnover problem.
2> rent control or other "low-income" concession. Waiting lists are long, developers resist creating more supply, and always have to consider the risk of arbitrage.
3> extra jobs / graft - competition for outside security work is pretty tight, and I'm sure we can all agree another cop on the take is something the world doesn't need.
We could try a variant of option 2 and provide housing subsidies for certain professions, something I think the FBI does for agents in certain areas, but then we run the risk of creating castes. I doubt anyone would entertain subsidizing a barista's rent just so they wouldn't have to commute 3 hours to a Starbucks in Beverly Hills. But it might happen for a cop (probably not.)
The degenerate case is all the cops leave and the rich have the opportunity to fend for themselves.
http://ideas.ted.com/the-4-biggest-reasons-why-inequality-is...
Claims 1-3 from your link are claims of instrumental wrongness of inequality claims 1-3 from your link. They point at bad consequences (rich people will control the media, rich people will corrupt the government, rich people will have unfair advantages for their children).
As the author of the article you links points out: "In principle, these effects could avoided, without reducing economic inequality, through such means as the public financing of political campaigns and making high-quality public education available to all children". It's not that inequality necessarily must cause these consequences, it's that it will tend to under some (most?) given policy regimes.
I think I misunderstood your original comment...when you said that "Inequality is not per se bad" was incorrect, I assumed you were making argument #4, which I did not see debated hardly at all. Most people were making some variant on arguments #1-#3.
In which case, I would respond to you: Paul does talk about the bad consequences and bad causes of inequality, and claims that you should address those causes and consequences directly rather than attempt to limit inequality in itself. The argument against this has to come in some form of "well yes, in theory it's possible to limit the bad consequences of inequality, but in practice it's too hard because X and thus we should directly attack inequality".
I didn't see anyone really saying that, everyone seemed to believe Paul thinks inequality doesn't have bad consequences or that he thinks we shouldn't address those bad consequences.