Hacker News Reader

Thanks so much. 27b is a favourite model and last night my dev ran some benchmarks to achieve 133tks about 3.2x which changes the economics.

great to hear, which quant + KV quant + KV size are you on? is it llama.cpp?

it's got a loginwall

I just copied and pasted it, can't do markdown.

https://pastebin.com/FAdBbGUd Qwen3.8-27B on an RTX 3090: Inference Options and Benchmark Results

Thank you!