> you have the philosophy of animism sitting side by side with metaphysics as if there’s some meta category that encapsulates the two.
Sorry, what are you referring to? Where do these things sit side by side?
> Yeah I can meta the entire universe together
Metaphysics is very specifically about the underlying assumptions of physics. It always has been, even though the meaning of the word physics has changed wildly over time. The current meaning of "physics" dictates that it is a metaphysical question whether, for example, quantum theory or string theory are correct. This is metaphysical because it is about underlying assumptions which cannot yet be tested experimentally.
You seem to be taking anyone who uses the word "metaphysics" as actually doing metaphysics, but no professional physicist or philosopher believes this. Some people may well call themselves "physicists" and then talk about ghosts, but it is nonetheless widely understood in the profession that physics is in no way about ghosts. This is similarly true of metaphysics and animism.
When we speak of historical beliefs that are no longer current in civilization, then sure, animism might show up and be presented as "metaphysical", but so what? Newton was wrong about corpuscles being the fundamental unit of matter, but that doesn't mean he wasn't doing physics. It just means he was wrong about part of his system of thought, which is always to be expected when looking at past thinkers.