But the insight is that although both features are informative, classical training approaches result in networks that over-fit on texture information and ignore shape information.
Table 2 of the discussed paper finds that joint training with "Stylized ImageNet" (IN images after a style transfer) and classic IN followed by a fine-tuning pass on IN results in improved classification accuracy over IN training alone.