If you ignore the fact that only those whose families are at least comfortable financially can afford to take the risk necessary to get into a position where they can begin exploiting other workers.
Globally, the vast majority of capital is owned by people who grew up rich.