I think the first true strong AI will come from research on non-equilibrium thermodynamics. We need to get down to the basics: where do entities come from that self-organize, more specifically that are able to use information in structured energy arrays to find and dissipate negentropy deposits, and dissipate that energy in order to maintain their own state away from equilibrium and hence avoid dissipating themselves? In short, strong AI will not come from top-down research on problem solving or learning, but bottom-up research on what makes autonomy and agency possible.

Goedel machines might actually be the closest thing to this in the computing literature, my reaction is less about the work itself than the rhetoric surrounding it, to be honest. JS should collaborate with a physicist on the thermodynamic side of the problem.

If you're intrigued, you could start with the article I linked above, or if you have journal access, anything from the same special issue. I chose that article just because it's the only one not behind a paywall.