I'm running qwen 3.5 397b on very standard hardware. Just use the unsloth quants, they're great. I get like 20t/s or something.
It's super not a publicity stunt, qwen 3.5 is the base of the best local models out there IMO.
It's super not a publicity stunt, qwen 3.5 is the base of the best local models out there IMO.
There's smaller models all the way down too.
Like this should be _exactly_ what we want companies to release.