All the things you mention are forms of luck, yes. And there's no way to control for them outside of some nightmarish eugenics scenario. It's a fact of life that people are different, and will excel in different facets of their lives to different degrees.
In a free market system there will always be winners, losers, and a lot of us in the middle. That's a result of the system BEING an equal playing field, talent and money are correlated. It'll never be the case that we all go into the workforce on equal footing, because we all start out in different places, with different genetics, and different upbringings. That doesn't mean someone from a poor upbringing can't work hard and raise their market value (thus making more), but it means that not everyone is going to be a millionaire.