I can't really judge at this point, but I really doubt there is hardware limitation for that, e.g. iPhone 15 Pro isn't so much powerful than iPhone 15. Even when it is - they could utilize their server side AI solution, but for them greed comes first.
That 2GB really could make the difference: they have a 3B language model, which is going to be memory hungry. There needs to be enough memory left for the rest of the phone and apps to function.
Even when it is - they could utilize their server side AI solution, but for them greed comes first.
You were saying above that you’re glad you don’t have it and now you’re complaining that you don’t have it?
And a reminder that Phi1.5 comes in at 2.8GB.
Getting a performant model even while using aggressive quantization is going to require more RAM.
iPhone 16 ProAI may end up having notebook levels of ram (12 / 16GB)
Probably they could offload more to their servers but it wouldn’t be the same experience definitely.