I recommend this series of posts on frequentism and bayesianism. Of particular interest is part 3, which has a very good explanation of why frequetism shouldn't be used in science.

    Let me say it directly: you should be suspicious of the use of frequentist
    confidence intervals and p-values in science. In a scientific setting,
    confidence intervals, and closely-related p-values, provide the correct
    answer to the wrong question.