https://github.com/ggerganov/llama.cpp/issues/39
40GB for the big llama.
40GB for the big llama.
We have almost closed the gap in no time whereas on ChatGPT day 1 it seemed they were years ahead. Hopefully there will be more models and developments.
Maybe not first of the class but there is a lot value to be found in the middle ground and it's good for the market as a whole.