Hacker News Reader

It can't be run locally,can it ?

I see that the training need 8xA100 80G and running need cuda but I doubt it need 8xA100 to run.

It's a model with 7B parameters, it runs on a potato.

With quantization you can run this on a Raspberry Pi.