Hacker News Reader

Obviously cpu

No. Ollama takes advantage of Metal on Mac M1.

Not obvious to me. I thought these AI things required vast amount of GPU power. Or is that for the training part?

Inference works fine on CPUs while a bit slow but fine for a chatbot