I really love how this very clearly visualises the need for statistical significance. To me, a novice, the A/A/B chart is wildly more illustrative of a point than the an A/B chart based of the same sample data with some significance number next to it. I understand from some of the comments here that there's all kinds of ways in which this A/A/B thing is subpar. But, if the chance of someone misinterpreting a chart decreases more than the chance of the chart itself being misleading, then isn't it a big win?

I'm really nerd sniped here. Is there any branch of statistics that focuses on human understanding? For example, there's all kinds of blogs and stories out there about how doctors routinely make wrong choices because they don't understand statistics well enough. Is there any serious body of knowledge that explores ways of getting these doctors to make these mistakes less frequently, without having to send them to sites with titles like "An Intuitive Explanation of Eliezer Yudkowsky’s Intuitive Explanation of Bayes’ Theorem"?