What's interesting is we're currently training AI on how to use vector databases. Next generation LLMs trained on GitHub from the era of LangChain and FOSS vector DBs will be able to self-program their own long term memory recall. I don't think that just chunking and storing vectors for all of the text the LLM reads is the best approach, but it might be able to apply a strategy to each unique situation that is more optimal.