Humans handily outperform GPT4 handily on the task of "write a random string of length [x]" for any x > ~25.
"Here is a random string of 32 characters:
a8Jk5pYr0Dm9Nc1Vz8Qf2Bt6Hg3Lw4Uo"
I’ve tested this with a wide variety of number inputs and it’s performance is highly variable. Error also increases linearly with strong length.
does a 4 year old have intelligence?
Logic, arithmetics, algebra, precisely following steps of an algorithm - those are not skills one "kinda" just "gets" at some point, they're trained by deliberate practice, by solving lots and lots of problems specifically constructed to exercise those skills.
Point being, get GPT-4 through school, and then compare with adult performance on math-adjacent tasks. Or at least give it a chance by prompting it to solve it step-by-step as a problem, so it can search closer to the slice of latent space that encodes for relevant examples of similar problems and methods of solving them.
Anecdote: admittedly, I'm autistic as are the people I know, so maybe that's not a good sample. I struggle with a lot of basic shit even as an adult. Oh god, I empathize with the hypothetical GPT5.