770 karma · joined October 28, 2021
There are plenty of words for transactions that should be limited to money you can afford to lose: Las Vegas, lottery tickets, options, crap, toxic waste, street drugs.
Poles in the right half-plane indicate instability. Zeros in the right half-plane indicate something a little more subtle. I believe the article is about the latter.
Comments: The OP is a troubling covert political statement. The real issue here seems to be US midterm elections / climate change / COVID / appeal to authority.
I thought we were discussing statistical mechanics.
I'm making a pedagogical point. The OP addresses how difficult entropy is to understand. I'm responding to that. We don't need to talk about "knowledge" when you define entropy, or in an initial explanation of entropy. We could, but we could decide not to.
The log(x) example is a good one. First-time students who are learning about logarithms don't need to be told that a logarithm depends on 'knowledge' or on 'information.' It's ok to just tell them how logarithm is defined.
Sure, there is information. I'm saying it's confusing and unnecessary to introduce more big ideas like information, when the topic is "entropy is difficult to understand" or "logarithms are difficult to understand."
Adding "knowlege" to the definition (or to an initial explanation) of entropy makes that learning process even more difficult. And it's unnecessary. It's better than the older talk about "disorder" but it's distracting. We can bypass 'knowledge' and come back later, with no penalty and plenty of time savings.
Apart from that single pedagogical point, we seem to be saying the same things back and forth to each other in different words. I'm not sure why.
What I'm saying is pedagogical. We need to define our macro-states. We don't need to go on and talk about our definitions being information or 'knowledge.' We could just use the definitions and calculate. We can talk about 'knowledge' but we don't need to.
The exception is when we actually have some information about what macro-state some system is really in. Obviously we then have to build that information into our model, and the entropy changes. What I'm saying is this: it's not necessary to mix that into our definition of entropy. That definition is not going to help folks who don't understand entropy, and it's unnecessary.
If we just define the macro-states, we're good to go. We don't need to talk about 'knowledge'. We can talk about 'knowledge', it's fine, but that lets in unnecessary woo.
That seems to be correct.
>Yeah the author is conflating low entropy with a low number of microstates
Since entropy is found by counting micro-states (for example your third paragraph), that should be ok. What am I missing?
Say I flip 8 coins and I don't look at the results. A fine-grained macro state is TTTT TTTT. A coarser-grained macro state is TTTT xxxx. The one has 4 bits more entropy than the other. It works the same way in statistical mechanics. Call them spins.
We're just talking about some ensemble of micro states, and then we divide the ensemble up into macro-states. To do statistical mechanics at all, I think I have to define some macro-states according to which micro-states they contain. That doesn't mean I necessarily have any information about which macro-state the system is actually in.
If we happen to know, then, sure. For example we could pick a weird-ass observable state, and when we saw it we would know the entropy of the system was low. But the entropy of each macro-state just depends on how many micro-states we define it to contain. It doesn't depend on our knowledge of the system state.
Does information content mean this? ... "How many bits of random-number generator would I need to make the number of micro-states in the macro-state?"
I think it can probably be expressed either way. I just think the "knowledge" part is tricky and can be left out.
Question: Why is it when I drop a vase it smashes into a million pieces; however when I then drop the million pieces it does not form a vase?
Answer: Stop! Don't drop any more expensive vases. Start with these simpler systems that do repair themselves sometimes when you drop them.
Take a coin and align it so the 'heads' side faces up. 'Heads' means 'unbroken'. (The reason for that will become clearer as we do more experiments.) Now drop the coin on the floor. How often is the 'heads' side still facing up? Now if you drop it again, how often does it 'repair' itself so that the 'heads' side is up? (Really do this.)
Try the experiment with 2 coins. Align them all heads-up, drop them, then see if your pattern is 'broken'. ('Broken' means not-all-heads-up.) Drop the 'broken' coins again. How often do they 'repair' themselves? ('Repaired' means all heads-up.) ( Don't think about it! Don't solve for it! Do it! )
Try again with 5 coins. How often does a 5-coin system 'break' when you drop it? How often does a broken 5-coin system 'repair itself' when you drop it again?
How about 10 coins? How often does a broken pattern of 10 mixed heads/tails repair itself to all heads when you drop it again? Sometimes it does, but you'll have to be very lucky or patient to see it happen.
I think from here you can probably see (part of) the answer to your question about the vase. The word people use for this kind of thing is 'entropy'. With enough coins, the 'broken' state is much more probable than the 'repaired' state. The log of a probability is called 'entropy.'
https://www.quora.com/Why-is-it-when-I-drop-a-vase-it-smashe...
Example of a tricky situation: Say we play cards. You shuffle the cards well, and you don't show them to me. I might say the order of the deck is random, to indicate that I have no idea which card is in what position. But you might be looking at the faces of the cards. In that case you might say the same cards are ordered in a way that's not random.
Could we describe the same situation using the word arbitrary but not the word random? I'm not sure. Seems likely.
I know how to make up models and test the models by experiment. I don't know whether randomness is real or not. I don't think it's deeply meaningful what words we use, as long as it's clear what the math is and how we're applying it.
"Random" means I draw up a list of all possible outcomes. The probability of an event is defined as the fraction of outcomes in which that event is true.
Example. Choose two numbers "randomly" between 1 and 3. What's the probability that the two numbers are equal? The list of outcomes is: (1,1),(1,2),(1,3),(2,1),(2,2),(2,3),(3,1),(3,2),(3,3). There are 9 possible outcomes. In 3 outcomes the first and second numbers are equal. So the probability is 3/9 = 1/3.
The math part is just bookkeeping.* The math isn't random, it just uses the rule above. And there is no claim (within the math) that things are or aren't "really random" in the actual world.
*Can be very slippery bookkeeping. People who know what they're doing get wrong answers all the time. But bookkeeping.