I'm looking forward to a 4-bit quantized version that I can run on my Intel Thinkpad with 32GB RAM, should be almost usable if its as fast as a 14B size model.
Whether it's any good is another matter, I guess the leaderboard on HuggingFace will be updated at some point.
what a sick project to be able to attract a billionaire programmer [0] and c royalty.
For those out of the loop, who are the billionaire programmer and C royalty people in this link?
The linked comment is authored by the CEO of Shopify; the top-level comment in this thread is the .. what would you say, author/originator/founder of Redis. (And maybe/presumably more widely known in C-land for other projects or contributions, idk.)
I also looked at the threads and had no idea who they were referencing.