It is almost as if there’s a documented limit in how much you can squeeze out of autoregressive transformers by throwing compute at it
Is 1% relative to more recent models like o3, or the (old and obsolete at this point) GPT-4?
It was relative to the number the comment I replied to included. I would assume GPT-5 is nowhere near 100x the parameters of o3. My point is that if this release isn't notable because of parameter count, nor (importantly) performance, what is it notable for? I guess it unifies the thinking and non-thinking models, but this is more of a product improvement, not a model improvement.