This made me think about a conversation I had recently with a friend who is a researcher in Natural Language Processing. Obviously what we now call LLMs have taken her field by storm, which now mostly consists of trying to understand how the fuck they work.
I mean, we know they work, and they work unreasonably well, but no one knows how, no one even knows why they work!