Have you compared it with 8-bit QwQ-17B?
In my evals 8 bit quantized smaller Qwen models were better, but again evaluating is hard.
In my evals 8 bit quantized smaller Qwen models were better, but again evaluating is hard.
I think they should’ve named it something else.