The 'very rich' can afford to spend extravagantly to acquire bitcoins, and can afford to do so at 'a loss' if they actually have some good reason to convert money from other currencies to BTC. The average poor or middle-class person who has bitcoins to sell will be unlikely to turn down an offer to buy BTC at above market prices or similar other arrangements.
You can argue that Bitcoin is a threat to the revenue streams that the 'very rich' rely on to become wealthy and stay wealthy; however, it is mostly a threat in that it displaces those revenue streams. Speculators that currently work in things tied to USD can just as easily do their speculation against BTC; you do nothing to put those people out of work. Investors, likewise, are not somehow directly threatened by a Bitcoin-based economy. It's just currency to them.