Hacker News Reader

And it's hilariously bad (in comparison to regular chatgpt).

And slow. They never tell you that quantization of many LLMs slows down your inference, sometimes by orders of magnitude.

It depends on the quantization method, but yes some of the most commonly used ones are extremely slow.