Even if you had all that you would get completely different weights out at the end, and you also don't have the resources to "compile" an LLM because the compilation can cost $100M. If you were given the training data but not the weights, would you consider that open source?
This can't be used to save VRAM in practice. To generate a new token with the primary model, you first need to decompress the cache, which involves regenerating the whole sequence from scratch. I.e. generate 1 million tokens with the small model to generate 1 with the large.
You can use the original model to compress the kv cache and get ∞x compression, since the prediction is perfect. The cost is time, and I don't see how this could be worth it.
I wonder why that's not supported by Biscuit despite dozens of other functions being present. E.g. download and display an image once an hour. Can't wake from sleep regularly?
You're being downvoted, but you're right. Determinism is a different concept and doesn't characterise LLMs well. You can have deterministic random number generators for example.
There was a recent HN post where they checked the oxygen hypothesis (insects grew this large due to higher atmospheric oxygen levels) and it didn't hold up