> The level of naievete around this stuff is quite incredible.
"Emergent properties" has a formal definition in the literature.
In machine learning we don't explicitly program the machine to understand anything. It automatically learns patterns in the data. That's the entire point of machine learning. With such a large neural network and training set obviously it's hard to predict all of its capabilities due to the sheer scale of it all. Of course we cannot predict exactly how it will model things.
Take this for example. No one programmed it to understand Go. It learned by itself and became the world champion. That's what deep learning is capable of.
https://en.wikipedia.org/wiki/AlphaGo_Zero
"The neural network initially knew nothing about Go beyond the rules."