(and what is a non mathematical object anyway)
Physics and mathematics have evolved a lot and current research questions cannot anymore be discovered through simple experiments, one of the reasons is because an experiment would be too costly. But not always, some things are intrinsically difficult to observe or even impossible. In comparison mathematics is a 'cheap' and extremely powerful tool.
When a theory is developed enough, we can start to design again experiments to test it. This is simply an example of the scientific method which is applied. In practice, even if a theory is purely mathematical (which is never the case as usually those maths are developed by trained physicists in classical theories) its power is assessed by how much of our reality we can infer with it.
People mix frequently how the science make discoveries with what is true, in the case of Wolfram's theory, if it is enough to prove and infer interesting things, it is already worth studying it. If not for the sake of physics, at least for the sake of mathematics :)