I was thinking recently when reading that OpenAI is piping some of the textual prompts into iPython based on some rules, for example when someone asks for an answer that requires math. I could see ChatGPT piping to "itself" in the background and potentially having specialized AIs that would figure out better prompts from your prompt for example, among other obvious specialised ones like piping to image generation models and so on. You'd obviously also use an AI to choose what to pipe too. I agree with you eventually it'll be AI all the way down.