Why are you so snarky? Yes, of course this won't solve things it has never seen in its training set. It's not an AGI. But so what? It's still amazing nontheless. Is your point that since it's not "intelligent" we should dismiss it?
Everybody in ML (e.g., me) knows that.
But that's what we're seeing.
I'm saying: "Here's a test outside the training set."