> llama.cpp serves it over localhost at speeds that stop being a complaint after a few minutes of use.
"That stop being a complaint"? That's a strange construction.
I wonder if qwen 4 will make these smaller cards more viable by allowing the ngram storage to be hosted on CPU RAM.