HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by v3ss0n | Hacker News Reader
Parent
Full thread
v3ss0n
·
why not? both uses llamacpp as backend
View on HN
trzy
·
llama.cpp does not have interactive mode support for LLaVA nor the web server yet. So if they're just invoking the app, there is a lot of overhead for each call until they add that in. This server doesn't have that issue.
Reply on news.ycombinator.com