Hacker News Reader

You can play with Llama on your CPU. Depending on the model you use and the RAM you have available, the performance may be acceptable.

using llama.cpp

it runs on the CPU

this news story is that they are now extending GPU support to llama.cpp

Do you know about Oobabooga?

You can probably find a google colab link.

Is that like a LLM Stable Diffusion? Neat.