How is it going? Intrigued enough to possibly get an M4 Mac with 128GB RAM if it's worthwhile...
Apple is going to make so much money if they keep pushing on-device LLMs. It makes absolute sense to sell more macbook pros
Assuming they keep improving, yes. The one I tried (I responded to the other reply with some output, which was great) is as fast as the cloud ones and nearly as good.