>This works well for me except the 15B+ don't run fast enough on a 4090
I assume quantized models will run a lot better. TheBloke already seems like he's on it.
I assume quantized models will run a lot better. TheBloke already seems like he's on it.
Because codellama is llama based it may just work possibly?