Hacker News Reader

Can I run this on my laptop. Is there any LLM models that are neatly wrapped as an app I can run on windows ?

KoboldCPP.

Just keep in mind that you need to properly format the chat, and that better finetunes will be available in ~2 weeks.