Walking and flying may not have a lot in common to you and I, but to a thing learning to crawl, there is a lot to be understood.
If I make a machine that walks to the store, I have shown that walking is sufficient to get to the store. I have not ruled out the possibility that you bicycle to the store.
But if there has been a long running passionate debate on whether walking could ever get you to the store, showing sufficiency can settle that.
Maybe we can teach an ML to whack-a-mole until we see ideas pop out which the ML doesn't think are repetitive correlation/causation/model-is-working effects
All theyre doing is feeding in pixel patterns and object information for specific scenes, and then calling the models ability to detect general correlations in those scenes "solidity", "inertia", and the like.
Any time where patterns in correlations are taken as an explantory model, we have pseudoscience.
Yes, inertia/solidity/etc. is the right answer for why physical objects show those visual correlations. But pixel patterns in some images are NOT models of inertia, solidity, etc.
Just as correlations in pixel patterns in the sky is not a model of gravity. The right model, eg., is F=GMm/r^2 which are variables not even present in the data. So no correlative model of a night sky will ever be a model of gravity.
You can figure out newtonian mechanics entirely on the ground and that clearly helps you understand flight. By analogy, getting more understanding about what limits exist in ANNs could plausibly help understand how the brain works (and vice versa).