The end results of any statistical exercise (frequentist or Bayesian) depend on something assumed.
On the negative side, the frequentist approach doesn’t produce a post-data probability for the thing of interest either.
It provides the probability of something else - as you mention - which can also be interesting but it’s not what people really would like to know (as the generalized misinterpretation of the meaning of frequentist results makes clear).