The unified GPU/CPU memory structure on ARM Macs is very, very helpful for running these LLMs locally.
…or is it just that the latter had a way too weak iGPU and not enough RAM for AI purposes, whereas the bigger ARM MACs have more GPU power and enough RAM (more than most affordable discrete graphic cards) so that they are usable for some AI models?