I'm no python expert but it looks like this does happen in memory: https://github.com/ianb/infinite-ai-array/blob/main/iaia/mag...
I can't imagine it's too hard to serialize the `existing` python dict so subsequent runs are deterministic
I can't imagine it's too hard to serialize the `existing` python dict so subsequent runs are deterministic
The problem* is that if a prompt changes slightly then it won't be a cache hit.
* okay, one problem.