The problem is not that it's fallible, but that there's no noncircular explanation for why it seems to work. Inductive reasoning doesn't have a rational explanation, only an intuitive one.

I don't think your claim is possible to prove statistically - what does "pure reason" mean? And of course it's "pure reason + empirical observations": even if they're not running reproducible experiments they still see natural phenomena.