I suspect this is obvious to the HN audience, but this work is nice little exposition on some concepts of Information Theory. I wonder if Claude Shannon had any thoughts on it.

https://en.wikipedia.org/wiki/Information_theory

https://utopiaordystopia.com/tag/claude-shannon-a-mathematic...