“Information theory” might be a misnomer.
Tho I’m intrigued by the idea that there’s more to information than Shannon. Any additional hints??
I’ve often thought about a dual metric with entropy called ‘organization’ that doesn’t Measure disorder/surprise, but measures structure, Coherence. But I don’t think it’s exactly a dual.