It is good to maintain some optimism that people will figure out what to do but there is a difference from rushing towards such a future and blindly assuming it will be good by default. Are there things you think we need to figure out to avoid a bad outcome?
> Interestingly I'd note that the two outcomes you listed (power concentration and loss of control) are dimensionally opposites!
One can imagine a world where both happen. For example, an arms race between two leading labs causes them to accumulate a majority of the world's compute and market share for intelligence, with the race dynamics at some point resulting in a catastrophic incident of a self-replicating botnet taking over a large part of the internet due to a rushed, reckless Hugging-Face style RL run.