944 karma · joined August 3, 2020
I wish the useful improvements would be ported to https://github.com/open-annihilation/open-annihilation which seems a better open source project.
This quote should have been highlighted earlier in the article.
> AFAIK, there's no large models designed for this yet.
Isn't BitNet b1.58 2B4T what you are looking for? (haven't tried it myself though)
I feel like we are moving towards a very specific answer, without much thought: AI.
Side note: it's manipulation either ways because you chose what to talk about, with a goal in mind.
This.
> However, he demonstrated a clear lack of understanding regarding what makes the bits "independent" or how to resolve the independence problem.
Yes, I didn’t want to call it out explicitly, but this is exactly the kind of thing that would have made my undergraduate statistics professor lose patience.