Imagine if physics was done this way.
But it is...
1) We test theories with experiments to see whether they fail for that particular "input", we don't prove them correct.
2) One of our two best theories (QFT, the other being GR) doesn't even make sense, mathematically.
In fact the great challenge of physics today is that we have neither experiment nor mathematical rigor to stand on: http://groups.google.com/group/sci.physics.research/browse_t...
A theory that gives correct results for a limited range of phenomena but isn't absolutely correct or mathematically consistent is still useful. Same for programs, I would think.