Hacker News Reader

The Apple M series chips are solid for inference.

Correct me if I'm wrong, but I thought everyone was still doing inference on the GPU for Apple silicon.

The Apple M series is SoC. The CPU, GPU, NPU, RAM are all part of the chip.

The RAM is not part of the SoC. It's a bunch of separate commodity RAM dies packaged alongside the SoC.