It's a distribution. If someone is moving down, then someone else is moving up relative to one another (which is how inequality is measured). Yeah, it might feel like one is more upward, but the net change can be equivalent if rich ppl move down, or poor people move up.