No, of course not. I know some hedge fund managers who grew up middle-class and achieved their wealth through grit and hard work. Whether we like what they do is another story; they're not part of the parasitic upper class, and they're generally not evil people. They have more in common with startup new-money.
The people I'm talking about come from a closed, powerful social network. They're not part of a social network because they're rich. They're rich because they're part of a scumbag old-boy network. And they get their wealth the same way corrupt government officials (notice that corrupt politicians are always rich) do: they steal it from society.
By the way, it's not arbitrageurs (which is what many hedge fund traders are) who are destroying society. Actually, most of them make markets more efficient in a way that's rather harmless. It's investment banking/M&A types-- people like Meg Whitman who make fortunes spinning IPOs (that is, robbing companies during the IPO process). That's another rant however.