"Statistics is a branch of mathematics dealing with the collection, analysis, interpretation, presentation, and organization of data." /wikipedia/
You can certainly practice statistics in a way that mathematicians would take issue with, but it's intrinsically a branch of math.