> a mathematical dual of the physical world.

This sounds right to me. More examples: syntax versus semantics, theory versus model, algebra versus geometry.

Here's something I discovered recently: "Meaning and Duality From Categorical Logic to Quantum Physics" by Yoshihiro Maruyama http://www.cs.ox.ac.uk/people/bob.coecke/Yoshi.pdf