This feels like the central limit theorem. Accumulating a bunch of random variables is going to produce a normal distribution, and a normal distribution has an infinite interval.
Numerical analysis was a field invented to give realistic error bounds.