Elo 1400 seems to equate to a top 30% player.
Source: https://chessgrandmonkey.com/chess-rating-percentile-calcula...
Source: https://chessgrandmonkey.com/chess-rating-percentile-calcula...
nonetheless, it's cool to see a model 'generally intelligent' enough to beat most players. what's more interesting to me is that according to OP's analysis, GPT4 is worse at Chess than GPT3.5...
> Occasionally it does make an illegal move
Since it would lose every game in which it made more than a single illegal move.
Intuitively, I would guess 1400 is the rating of an average kid who spent a year studying chess seriously.
It's been a while since I read a global demographics update, but not all that long ago the mode child would have been living on $2 a day.