Also, spending money and the consumption of stuff isn't "taking something from society". It is someone's job to grow, harvest, process, transport, and sell apples. Spending a dollar to purchase an apple supports all of those people directly. Those people spend their money on stuff and it circulates. Nothing is being "taken" things are bought and sold on a free-market.
I am arguing that hoarding wealth is the share that one takes from society. You are right that Musk doesn't have 250k shoes or houses, but that's why its problematic, it is wealth that could be spent circulating through the economy, it is wealth that is a claim on future labor and resources, it is the power over his companies, employees, industry, and society. All of these are a much larger "take" from society than buying an apple, a pair of shoes, a house, or any other good or service.