Having your own hardware to run LLMs will pay dividends. Despite getting off on the wrong foot, I still believe Google is best positioned to run away with the AI lead, solely because they are not beholden to Nvidia and not stuck with a 3rd party cloud provider. They are the only AI team that is top to bottom in-house.
I've used gemini for it's large context window before. It's a great model. But specifically in this benchmark it has always scored very low. So I wonder what has changed.
I don't know, but very recent Gemini models have certainly seemed much more impressive...and became my daily.
This is a great take
We should still wait around to see if Huawei is able to perfect its Ascend series for training and inferencing SOTA models.
Gemini 2 is really good, and insanely fast.
It is, but in this benchmark gemini scored very poorly in the past.