I'm didn't understand "Symmetry and continuity impart incredibly strong constraints on systems." Can you elaborate? Give an example if possible?
If a system has to operate the same way under rotation/reflection, that strongly constrains what the system can be doing. Think crystals or isotropic forces or, in the day job, what should happen if you negate a feature going into a neutral network then retrain. Should it matter from which perspective you look at a thing?
If a system is continuous then smooth changes to inputs should cause smooth changes to outputs. The system probably will be robust to small perturbations because they will result in small output changes.
https://en.m.wikipedia.org/wiki/Turbulence#Kolmogorov.27s_th... is something of an example.