Taking code that runs against one hosted LLM and running it against a different backend LLM is... not generally a big deal. So OpenAI being ahead—in the core model, at least—is just being ahead, its not a moat.
Taking code that runs against one hosted LLM and running it against a different backend LLM is... not generally a big deal. So OpenAI being ahead—in the core model, at least—is just being ahead, its not a moat.
- a large and growing ecosystem
- a massive installed base of backwards compatible hardware
- the ability to massively scale delivery of new systems
- and lots lots more
They now have scale that enables them to continue to invest at a level that no competition can do.
None of these are easily reproduced.
As per SemiAnalysis AMD in late 2024 can’t get essential software working reliably out of the box.
It’s easy to say AMD ‘is close to perfecting ROCM’ the reality of competing with Nvidia is much harder.
There are open source projects volunteer run projects[1] that are better than official AMD implementation in many ways.
ChatGPT was announced Nov 22. The opportunity has been clear for two years and still essential software breaks.