In case you like the store kv to disk so you can resume I keep this branch of llama.cpp that includes that same functionality

https://github.com/alainnothere/llama.cpp/commits/disk-cache...

And you know it's load bearing each of the load baerings parts that bear some load and load a bear... you fight a bear because it took a load... or something like that...