If anyone has moat related to Gen AI, I would say it is the data(Google, Meta).
If anyone has moat related to Gen AI, I would say it is the data(Google, Meta).
It's not an act of will or CEO dictat. It's about hiring and incentivising the right people, putting the right structures in place etc all in the face of competing demands.
Nvidia have a huge head start and by the time AMD have 'caught up' Nvidia with it's greater resources will have moved further ahead.
There is as yet no indication that AMD can match Nvidia's execution for the very good reason that doing so is extremely difficult. The head start is just the icing on the cake.
Taking code that runs against one hosted LLM and running it against a different backend LLM is... not generally a big deal. So OpenAI being ahead—in the core model, at least—is just being ahead, its not a moat.
- a large and growing ecosystem
- a massive installed base of backwards compatible hardware
- the ability to massively scale delivery of new systems
- and lots lots more
They now have scale that enables them to continue to invest at a level that no competition can do.
None of these are easily reproduced.
As per SemiAnalysis AMD in late 2024 can’t get essential software working reliably out of the box.
It’s easy to say AMD ‘is close to perfecting ROCM’ the reality of competing with Nvidia is much harder.
There are open source projects volunteer run projects[1] that are better than official AMD implementation in many ways.
ChatGPT was announced Nov 22. The opportunity has been clear for two years and still essential software breaks.
OpenAI brings absolutely nothing unique to the table.