I took a quick look into the paper. To be honest (I'm far from being an expert).
As I understand it seems they took some toy models, and tried to show that the models do not generalize out of sample.
To me it is unclear what does it say about much more complex models? So for example there might be already so much structure, that you do not need to generalize out of sample and maybe humans don't do it as well.