A really interesting point. I've always held that we are nowhere close to real AI because we fundamentally don't understand what intelligence is, and we are not building complex enough devices for intelligence to be an emergent property. However, that doesn't consider the possibility that with enough computing power and sufficiently sophisticated models, we could end up with intelligence accidentally bootstrapping itself out of other large models, even if all we are doing is creating linkages between models via API calls and other similarly "dumb" steps.