Hacker News Reader

Llama cpp is more of a backend software. Most front end software like kobold/open webui uses it

I found it only took me ~20 minutes to get Open-WebUI and Ollama going on my machine locally. I don't really know what is happening under the hood but from 0 to chat interface was definitely not too hard.

Reply on news.ycombinator.com