Hacker News Reader

Anyone know what the story is for running LLMs on apple hardware but using asahi?

AFAIK MPS cannot be used on Asahi, so it has to be done using Vulkan which will definitely be much slower.