I don’t have a good answer but would like one. I’ve got a not too old desktop with a 4090 and 64gb of ram, I’d like a local model also.
So for the parent's Macbook question `gemma4-26b-mlx` should work well.
For you with 24 GB VRAM, `gemma4-26b-a4b`. I tried higher VRAM models and they slowed down while still doing just as well or slightly worse.
If someone else tests and finds a better performing model though, please update me here, I'd love to try it.