Hacker News Reader

I am running linux with cublast offload, and I am using the new 3 bit quant that was just pulled in a day or two ago.

Thanks! I'll have to try the 3bit to see if that helps

cuBLAS or CLBlast? There is no such thing as cublast