The obvious next step is where you can easily put new knowledge inside the parameters of the model itself.

I want the AI to know my codebase the same way it knows the earth is round. Without any context fed to it each time.

Instead we have this weird Memento-esque setup where you have to give it context each time.