Forgive me if this is a naive assumption, but wouldn’t large language models be fundamentally different for a language that is largely symbols?
Again, my understanding of Mandarin is limited if it exists at all.
> LLMs strongly prefer word-level tokens, and word substitutions follow semantic similarity and not the more human auditory similarity.
Is this an elaborate joke or your full-word misspelling of writing is both agreeing with your statement (word substitutions) and contradicting it (not semantic but only pronunciation similarity)
That's zero ex oh (the letter) five