The relationship between math and statistics is an interesting one. In my experience, "Statistics is a form of Math" is true when the math folks want it to be, and is a totally separate thing that doesn't belong in the club at all when they don't.
You can certainly practice statistics in a way that mathematicians would take issue with, but it's intrinsically a branch of math.