Do we a know whether the current SOTA foundation models (Gemini, gpt4o, Claude, etc) are actually all GPT-based (as in, causal models)?
They make impressive demos, but I can't recall any of their released models being at the top of any leaderboard.
EDIT: Sorry, looking into it a bit more now, they still seem to be at the top in term of the context window, so they got that going for them.
But I believe we’re confident that all major models are causal transformer models right now.
No reason to believe otherwise. If one of them was doing something different, they’d let us know in order to stand out.
“Transformer” is the name of the algorithm behind popular LLMs.
GPT is the name that openai gave to their models early on.
The Otis company invented the term escalator, and even had a trademark on it for a while, but does it mean that you'd only call one an escalator if it was made by them?
Why try arguing this?