The thing I find most interesting about LLMs is the emergent skills that happen almost instantly(based on model size) that weren't inherently trained for.

Picking movie names from emojis seems like something other than interpolation.

https://www.assemblyai.com/blog/emergent-abilities-of-large-....