Especially as an OG (first author to use the word?): https://people.math.harvard.edu/~ctm/home/text/others/shanno...
> If the base 2 is used the resulting units may be called binary digits, or more briefly bits, a word suggested by J. W. Tukey.
[Edit: also, consider the section "3. THE SERIES OF APPROXIMATIONS TO ENGLISH" to be an early exploration of MLMs: Microscopic Language Models]