Gemma 3 4B QAT int4 quantized from bartowsky should barely fit in a 4GB Raspberry Pi, but without the vision encoder.
However the brand-new Gemma 3n E2B and E4B models might fit with vision.
However the brand-new Gemma 3n E2B and E4B models might fit with vision.