Hacker News Reader

Investigate r/LocalLlama as they have various harnesses and llama.cpp forks to get models working well on your specific hardware.

Thanks, will do.

LLMs up and running but runs very slowly with Nvidia 16GB GPU and 32 cores on my laptop.