GFA Basic !… So many memories are coming back to me.
8 karma · joined May 12, 2017
Genuine question : is there something fundamentally wrong with Ollama ?
I use Ollama because it is easy to set up and manage (and also because VLLM is not super Windows friendly).
I thought the main advantage of VLLM was better concurrency management (better batching).
But if the quality of the interference itself is an issue, then maybe I should reconsider my choice.
http://patft.uspto.gov/netacgi/nph-Parser?Sect2=PTO1&Sect2=H...