My main worry is that a small set of capital owners will vastly benefit in a runaway AI scenario at the cost of human laborers (including service workers). If a few companies control essentially infinite intelligence, they could capture all the income currently paid to workers, while the vast majority of workers are left obsolete.