In the end it's not about the money. As you said, there are lottery winners who lose everything in a few years, and there are people who build a new fortune after losing everything.
That doesn't mean that being born into a privileged life doesn't have advantages, but it's about way more than just the money. It's also the connections you have. The best example right now is Trump, who is a complete and utter failure as a businessman yet people keep throwing money at him.