> And in fact AI could come up with the next big idea, an idea like communism or Nazism or capitalism… and what troubles me about that is that it is very difficult for humans to keep control of that situation.
This to me is the best "are AI at human-level intellect yet" benchmark I've heard to date. Once AI can create a novel socio-political framework and convince humans to adapt it en-masse [0], I think we can safely say AI has far surpassed human intellect. (99.9999...% of humans can't accomplish such a task)
0: leaving myself some wiggle room with the definition of "masse"