The alleged origins of the naming of entropy:

When Shannon first derived his famous formula for information, he asked von Neumann what he should call it and von Neumann replied “You should call it entropy for two reasons: first because that is what the formula is in statistical mechanises but second and more important, as nobody knows what entropy is, whenever you use the term you will always be at an advantage!

From:

http://www.spatialcomplexity.info/what-von-neumann-said-to-s...