Interesting, even as an English language model, inputting prefixes of other languages shows that the model has picked up a surprising amount of foreign language structure.