Along these lines, Gary Marcus said that "you can't build a ladder to the moon" [1]. In other words, neural nets do well on simple things, but general intelligence is such a high bar that neural nets (and statistical methods in general) can never reach it, without the addition of the sort of secret sauce that allows humans to really make sense of the world.

I used to be sympathetic to this viewpoint. But these days I'm more and more willing to believe that we can actually build a ladder to the moon.

[1] https://www.quantamagazine.org/common-sense-comes-closer-to-...