> All that statistics gives you is the probability of having a result at least this extreme with an unbiased coin.

If you subscribe to frequentist statistics and use the null hypothesis of "coin is not biased", yes. But if you're a Bayesian you can compute the probability that the coin bias is greater than a given amount.