If I didn’t know any better, I’d say OpenAI doesn’t want us doing these tests accurately and is trying to hide something.
Maybe it's different if you have a paid account?
If I log out, it shows 4o mini, and when I try to change it, it asks me to login or sign in rather than giving me any options.
When I use enough chatgpt when logged in it gives me some nebulous "you've used all your xyz tokens for the day". But other than that there is no real signal to me that I'm getting a degraded experience.
It's really just confusing as hell.
> With a free account the model it claims to be using is "4o auto", which is not a model but apparently an attempt to automatically decide models for you to be more cost effective.