Gemma 3 QAT Models: Bringing AI to Consumer GPUs

Pretty cool, I use gemma 3 on my mac m1 pro 16GB offfline during flights, and it is pretty good honestly.