It is worth saying that there are still situations where any use of quantitative probabilities becomes something of an abuse. The most extreme example is Pascal's Wager[1]; if you can assign a "small but meaingful" probability to any X you happen to mention in the discussion, you can assign a probability to the existence of the Great Old Ones or the Flying Spaghetti Monster or whatever implausible entity is going to create a hypothetical action of negative utility sufficient to counter it's unlikeliness.
And, of course, acknowledging some stuff outside of the domain of probability means you need a fuzzy border between two realms, which also can't be determined by probability.