I'll give a rather silly example: I recently saw a couple of people debating whether betting odds should give more accurate predictions of the outcomes of sporting events than other predictions. One person claimed that people are more risk-averse when their money is on the line and therefore should be expected to consider the probabilities more rigorously, while the other person claimed that it shouldn't matter whether one is putting up money. In other words, they were both making a priori arguments for why betting odds would or would not be most predictive. But in fact it is empirically verifiable that betting odds are more predictive than other models; no amount of a priori reasoning will lead you to the correct answer, only observation will.
All models have prerequisites, and logic requires propositions, which are either true or false. If you are trying to talk about models themselves (which is what most of math is), then logic is useful because it's easy to come up with propositions about models, and then you can explore what else must be true, or what else can't be true.
Probability and statistics are much more useful for explaining the world than logic. But we use logic to prove things about the models that we use in probability and statistics.
Logic is correct, you aren't going to find something logically true and then see it violated empirically. You are going to instead discover that the real world thing can't be neatly modeled as propositions. The error will be in producing the inputs to the model, not the model itself.
"They have a really good startup idea so they will be successful."
"We need to fire a salesperson so we'll pick the one with the lowest total contract value."
"The bus trip takes 43 minutes so I will be there at 12.17."
You'll note that these are not failures of logic (which is somewhat self-consistent and cannot fail) but rather of small-ish world views that don't allow for uncontrolled factors, which I think is a distinguishing factor of statistical thinking.
"My cat is sad" is not logically provable, but we feel comfortable that this idea is basically real enough. "vorpalhex has an internal monologue" is not logically provable, but we feel comfortable that it's probably true if I say it's true.
To go back to your original ask, for something that can be shown via Bayesian thinking but not logical deductive reasoning: "Intelligent alien life has never visited Earth". This can't be logically proven because of the observer paradox - the strongest statement we could defend logically would be "There is no known evidence that intelligent alien life has ever visited Earth" (which is a weaker claim). If we allow Bayesian reasoning, then we can defend that the likelihood that intelligent alien life has visited Earth and never left behind evidence is much, much smaller than the likelihood that intelligent alien life has simply never visited us.
In general, look into the analytic-synthetic distinction: https://en.wikipedia.org/wiki/Analytic%E2%80%93synthetic_dis...