The fact that someone is rich does not mean they took anything from 'you'. But the fact that there is such a disparity between their income and your income means they claim a much larger part of the economic output of the planet, and a much larger part of any increase in that output.