That's correct. The current base model is an int8 quantization of LaMini-Flan-T5-248M described here:
https://github.com/mbzuai-nlp/lamini-lm
I shared more details over on Reddit:
https://www.reddit.com/r/LocalLLaMA/comments/14btk3a/explore...
https://github.com/mbzuai-nlp/lamini-lm
I shared more details over on Reddit:
https://www.reddit.com/r/LocalLLaMA/comments/14btk3a/explore...
No comments yet.