I've had the same thought as above but unfounded (just a feeling, pretty much) so I'm curious to learn more. Do you have any references I can check out that supports these claims?
Come up with a novel puzzle that is guaranteed to not be in the training set, and ask GPT-4 to solve it.