Wait so Qwen trained QWQ 32B from Qwen 32B and then they distill QWQ back into Qwen 32B? What's the point?
This is massive marketing scam here. Borderline academic dishonesty.
This is massive marketing scam here. Borderline academic dishonesty.
From the title, my best guess was they applied some kind of RL/GRPO to an existing model.
But... they took an existing model that had already undergone SFT for reasoning... and then used it to generate data to SFT the exact same model... nothing wrong with that, but it doesn't seem to warrant the title they chose.
They didn't even change the model size, let alone try a different class of models.
Getting expert model's trajectories is trivial if you have vLLM to do batched inference.