> This model is provided only as sanity check for research purposes, it is untested and unfit for deployment.
I guess this means it isn't pretrained yet? Is it still just random weights?
I guess this means it isn't pretrained yet? Is it still just random weights?
It doesn't mean that there's anything technically wrong with the language model per se as a model of language, just that there has been no effort made to ensure it's fit to be deployed as-is for any given generative-AI use case, and the model authors would prefer you didn't do that.