Optics are modeled by differential equations. They describe a massively parallel phenomenon, light waves passing through and being modified by layers of media that, essentially, performs calculations using them. Warps and scales and so on. Clearly these particular differential equations are highly robust to architectural changes.
There's a parallel there to something else I've read about on Hacker News... what are those things called? Oh yeah, deep networks.
Are there any deep nets out there that attempt to mimic optics? or is anyone applying ideas from robust differential equations to deep nets?