I don't think your interpreting the sentence correctly, I think it's more correct to read it as:
> We don't [only] need [the formal discipline of mathematics known as] statistics to learn about the world.
Sure, there are things you can only functionally ascertain through statistical analysis. But not everything in the world needs rigorous statistics.