Your previous assumption reads more like math being able to model it, but scientists preferring elegant, aesthetic and simplistic solutions.
Looking at my PhD physics neighbor in student housing a few years back, it doesn't seem true though. He was juggling multi-page equations for his quantum field theory thesis.
In control engineering it's more true though. I remember one of my professors say that many people only use linear controls because there they can "prove" the stability of the system. In contrast to the nonlinear, i.e. everything else, control theory where such proofs were harder to get by.
However, he continued, proving the stability of a linear controller interacting with a linearized system could never "prove" the system's stability as a whole.
This seems more a limitation of what (human) mathematicians are able to model, rather than something fundamental in math itself. Perhaps in a few centuries we will have invented mathematical tools that allow the mind to grasp nonlinear systems better, similar to how the invention of better construction tooling has enabled the construction of ever larger buildings.
[0] To be far, I'm not actually positive that the 2 body problem in GR is actually computationally harder than massive polynomials, but there is no exact solution to it; and understanding the approximation is definitely harder.
We do, it's just that we choose different formulations for problems which require such solutions, or straight up don't solve them.
Think about the unsolvable n-body problem from classical mechanics. An equivalent of that problem exists in most scientific disciplines. We just choose not to think of those problems from the polynomial solving angle.
Read the news lately?