It's actually better. All the people claiming unannounced updates make OpenAI model significantly worse were misled by their own lying eyes. It's so hard to believe, I know, but it's true.
It isn’t, because performance isn’t scalar. It seems to be a more preferable chatbot in this arena. It is objectively less capable for many other domain specific tasks.
How does the arena work? ;)
Lol it’s literally called the “LMSYS Chatbot Arena”.
But yeah we tried some things.
It depends on the size of the response that you need…
ChatGPT was best when first released and absent of censorship ... Probably 10x worst right now
No clue, but it wouldn't surprised me if they identified inputs and training that weren't actually helping. Just as human beings aren't necessarily more helpful by having more varied input, the same seems to apply to LLMs.
The interesting thing is it still has a 128k context length. This is awesome because GPT became way more useful to me once it reached this level of context.
Just a caveat, this is 128k context length for ingestion, I believe the output is still constrained to just 4k tokens.
Yes, this is true. Nevertheless, that made a huge difference for my workflow. I haven't had to think about exceeding the total context in a long time.
Funny, I just got that matchup. I preferred GPT4-Turbo.