I'm guessing that your disquiet at this notion comes from the possibility that everyone is creating their own wealth, and to some extent that is no doubt true. But if you start with the simplifying assumption that everyone's wealth creation ability is equal, and you just look at distribution, and you find that your model pretty accurately reproduces the real-world distribution of wealth, it's at least some evidence that wealth-creation ability is not that different from person to person, and what's driving inequality is the distribution mechanism.
Since virtually all human traits follow a Gaussian distribution, it seems like whatever the wealth-building factor is, it would also follow a Gaussian distribution. But wealth follows more of a power law distribution. You never encounter anyone 1000 times taller than average, but there are many people 1000 times wealthier than average. This casts some doubt that wealth accumulation is down to individual human ability.
Couple that with the micro-economic observation that someone with 1 million dollars is astronomically more likely to make another million dollars than someone with 100 dollars, even if the two people are otherwise identical, and it seems pretty unlikely that wealth creation has much to do with the distribution we see.