Takes way more than that in my experience. Back prop isn’t sufficient for rapid generalization.
Well, I think you definitely need a certain level of scale, but I think it definitely still works. Also, generalization and memory are two very different things. Generalization is basically iQ, which is very much still a work in progress.