Agreed, this seems like the immediate future. Large language model which has access to a bunch of "widgets" that it can use to extend itself. I can see two types of such widgets.

First type is info widgets which allow it access information outside of itself, like using a calculator by making it output something like {calc 1+1}, search wikipedia by {wiki something}, see the results of such a query and use that info in its output to the user.

Second type is UI widgets that allow it to display different types of things to the user. There is already a kind of widget in ChatGPT, which is display of Markdown. But it's easy to imagine widgets for say showing coordinates on a map, or visualizing something else.

Since there is a large number of such useful widgets, I'm guessing there will be an app store for them where developers can write their own widgets to extend it and make revenue based on how much they are used.