What is the best performing Codellama model on a Macbook with M1 chip?
Will Gguf 7Bn 4bit quantized model be good to run locally on the Mac?
Will Gguf 7Bn 4bit quantized model be good to run locally on the Mac?
I used GGUF + llama.cpp.
Will try out Ollama.
Thanks for the info!