As far as I can tell, Deep learning in practice is pretty far ahead of the theory, so people are largely following their intuition around rather than being guided by theory.