I told you a while ago that llama.cpp supports 4/8-bit (and other) quantization just fine (and fast) on x86_64.
Also I see something much better. The same guy behind llama.cpp authors a universal ml library that does cpu quantization. I wasn't aware of that and it is far more impressive than running a couple of chosen models.