I wonder what companies like OpenAI will do if we see on-device AI becoming the mainstream. The entire business model is based on API access. Will they start selling offline models? I guess then piracy becomes an issue…
I'm not saying Apple couldn't do the same thing, but the model alone would take up so much space on the phone that it would not be practical. I can see Apple making something closer to a very fine tuned mistral 7B than GPT4.
But I'm sure in a year this comment will be wrong.
But 1, it’s still a profitable business to be in, so why shouldn’t OpenAI go there? And 2, more importantly, as hardware and software become more efficient, in the future on-device might be good enough to put up a fight and start eating the cloud. Seems risky not to go there.