I think Gemma 3 is marketed for single GPU setups https://blog.google/technology/developers/gemma-3/