So I might not have a great enough understanding but isn't 3.8 sigma not high for this kind of announcement (with the current title)? if someone wants to report finding a planet in the solar system ten times the size of Earth wouldn't they do so at more than @3.8 sigma. In particular, the prior is quite low because it would affect a bunch of other astronomical calculations, wouldn't it? So you would want the confidence that much higher....
http://www.dummies.com/how-to/content/how-to-calculate-six-s...
What I mean is that in human terms, Google says the average man is 5'9" with standard deviation 2.9 inches, then 3.8 sigma (the chances of this happening by chance) are the same as the chances of finding someone 6'8". It doesn't seem unbelievable - https://answers.yahoo.com/question/index?qid=20101208183308A...
If a woman is set up on a blind date and told the guy is 6'8" would she find it like not credible?
My understnading of statistics then is that the idea that there just so happens to be a planet ten times the size of Earth in our solar system is pretty unbelievable. So I'd want the chances of it being an experimental fluke to be lower than seeing a 6'8" guy, anywhere, at any time, in any context. Because I would think that's what happens when you look at enough data.
- Aren't the chances of this being completely spurious literally exactly the same as a researcher saying "I saw a 6'8" guy somewhere", meaning anywhere, in any context?
Wouldn't you want higher evidence before stating "evidence found for ninth planet in our solar system, ten times the mass of Earth"?