I think this still holds some water. The go bot was excellent at beating really good go players because it had a ton of data on high level go games. When it encountered someone intentionally doing a moronic strategy, it was trounced. It just didn't have enough data on bad players, so it lost to an obviously flawed strategy.

I think that's the huge flaw in all of these ml systems. They don't build fundamental understanding. We're brute forcing it in a way, but perhaps we're losing something in the long tail.

E: https://arstechnica.com/information-technology/2022/11/new-g...