Hacker News Reader

Hardware and cost is assumed to be approximately desktop-class. If you've got a gaming rig with an RTX 4090 and 128MB RAM, you can run this if you pick the right quant.

View on HN

128MB? Quantization has come a long way!

I think they mis-spoke 128GB* :)

Wishful thinking there on my part.

Though technically < 1GB is enough - one had offload it to the SSD, albeit with very slow speeds!

Reply on news.ycombinator.com