You can’t understand much about statistical inference without calculus.

It’s all integrals over pdf’s. A lot of integration by parts and other things in the core curriculum.