ParentFull threadcoeneedell·I wonder if reducing the bit depth of parameters like we have been acts as a normalization feature in these huge deep models.View on HN