Tiny-Qwen: Minimal PyTorch Re-Implementation of Qwen3 and Qwen2.5-VL
github.com
github.com
If you like Andrej Karpathy's nanoGPT but can't find one for great open source models such as Qwen, this repo is for you!
It includes all variants of Qwen3 and Qwen 2.5 VL, with text + image input support and both dense and Mixture of Experts implemented from scratch.
Feel free to leave a star or any feedback