It's already possible to get some of this effect with codex. The trick is to keep appending the interaction in the prompt (to maintain a memory of sorts).
For examples, you can replicate all the prompts here: https://twitter.com/yoavgo/status/1599200756631887872 with prompt + memory.
The notebook at https://github.com/madaan/memprompt/blob/main/YoavsPythonPro... shows a demo of this.
Some of these ideas were earlier discussed in our work on memory-assisted prompting [1].