Hacker News Reader

"ChatGPT" could mean anything from Instant to Pro. What was the prompt, and which model(s) did you try?

Almost surely the free model on the web ui. So a dumb model, no harness, and probably a bad prompt.

My point was that the kind of error it made was nothing like the kind of error a contestant would make.

The differences between 'instant' chat models and frontier-grade models are enough to render any such test a waste of electricity.