What is HN’s fascination with these toy models that produce low quality, completely unusable output?
Is there a use case for them I’m missing?
Additionally, don’t they all have fairly restrictive licenses?
Is there a use case for them I’m missing?
Additionally, don’t they all have fairly restrictive licenses?
I remember when going from 6B to 13B was crazy good. We've just normalized our standards to the latest models in the era.
They do have their shortcomings but can be quite useful as well, especially the LLama class ones. They're definitely not GPT-4 or Claude+, for sure, for sure.
So this is similar to a mid tier GPT3 class model.
Basically, there's not much reason to Pooh-Pooh it. It may not perform quite as well, but I find it to be useful for the things it's useful for.