— Claude Shannon
— Claude Shannon
I think the thermodynamic law throws everyone off. Entropy is not the axiomatic law. The law is probability, and this same law also powers our science.
Yes, and I think the other big plunder often committed is explaining entropy in thermodynamics as a measure for "disorderliness". You might get away with that if you want to explain diffusion processes to a class of high school students, but even then the idea quickly falls flat on it's face once they realize that in chemistry things crystalize out, often after giving off thermal energy. (Also, "disorderliness" is a fairly subjective concept)
In this case rolling 10 dice increases order but that order represents increasing entropy.
So for example the loaded dice are programmed to always roll a 6. Thus the most predictable and ordered outcome (all 6s) is also the highest entropy state.
Entropy simply says that over time the configuration of certain entities within a system will progress towards higher probability configurations.
For most systems (like for example, non-loaded dice) the most probable outcome is a disordered state. But this is not the case for all systems.
Take our solar system for example. The most probable outcome for the configurations of all particles orbiting our sun is to form perfect spheres (planets). This is the highest entropy state of the system. The system by itself naturally progresses towards spherical configurations that we can only describe as ordered.
However, when people talk about entropy in terms of heat. Entropy is indeed in this case measuring disorder. But this is a very specific definition of entropy for one type of system and the more general definitions are the ones provided by information theory and statistical mechanics.
Or, conversely, God cares very much about the universe having an arrow of time without any notable time-asymmetric properties, and had to make up all sorts of information patches to make that happen. In that case, probability flows downstream from thermodynamics.
Could you write or cite what the formula would be in this case?
It appears to me that the formula for entropy itself recursively suffers from rising entropy. Thus you cannot reverse it... You cannot derive individual probabilities of each state from just entropy. Source: https://en.wikipedia.org/wiki/Entropy_(information_theory)
(in terms of the mathematical formula from Wikipedia, by saying you can't reverse it, I am saying that no individual P(xi) can be determined when you are just given H(X) as an input)
Thus because of the reasoning above, probability must be the axiomatic source of entropy.
It makes sense intuitively. Entropy is the macro phenomenon arising from the micro phenomenon of probability.
The law of numerically higher probability events being more likely to occur then numerically lower probability events when following the arrow of time is the more fundamental explanation of what's going on here. Entropy is simply a macro numerical summary of these probabilistic events happening in aggregate.
http://blog.rongarret.info/2014/10/parallel-universes-and-ar...