I just don't see OpenAI scaling to the moon when the moat around their product is so shallow and disruptable. What is their long-term play besides having an API that can be replaced with by changing a POST request URL?
I just don't see OpenAI scaling to the moon when the moat around their product is so shallow and disruptable. What is their long-term play besides having an API that can be replaced with by changing a POST request URL?
It's certainly not outside reality for the well-known software companies to have divisions working on it, but I don't think we're quite at the point where garage startups can afford the compute.
Why not? The majority of these models are running on fairly ubiquitous datacenter GPUs. They're being trained on highly available hardware. You're right that there's a compute barrier, but you get around that by throwing money at the problem. If someone was sufficiently motivated, they could probably dethrone OpenAI in 2 months with enough funding.
I'd argue Google is sufficiently motivated to dethrone OpenAI --- so why haven't they? They have plenty of money to throw at the problem as well.