Article is new but paper mentioned within is from 2019, predating LLM revolution. From abstract:
>We show here, using quantitative methods on a large cross-linguistic corpus of 17 languages, that the coupling between language-level (information per syllable) and speaker-level (speech rate) properties results in languages encoding similar information rates (~39 bits/s) despite wide differences in each property individually: Languages are more similar in information rates than in Shannon information or speech rate.
Quite interesting result. Curious how constructed language Ithkuil, designed to convey information in highly compressed manner, compares.