> Statistical power is simply the likelihood that the difference you’ve detected during your experiment actually reflects a difference in the real world.

This seems incorrect to me. Isn't statistical power the likelihood that the null hypothesis would generate an outcome at least as extreme as what you observed?

I'm guessing the issue has a lot more to do with peeking at the outcome and not correcting for it (and similarly running many tests)

http://www.stat.columbia.edu/~gelman/research/unpublished/p_...