If you couldn’t tell, this is LLM generated quackery.

Any claims about throwing away 2/3rds of the model weights (not just quantizing them) and maintaining “near lossless” quality are simply false.

I clicked on the benchmarks page expecting some quality benchmarks but only saw speed benchmarks before I gave up and stopped scrolling.

The claims don’t even make sense. It’s showing “100% GPU resident” for a model of a size that cannot fit into the GPU.