"But it is not a study of it! Mathematics is a tool, not the thing being studied."
Who knows? Mathematics turns out to such an acute tool for understanding physics. One might be inclined to say that we live in a mathematical reality. The quoted statement is more a statement of philosophy than of fact.