Scaling AI at Cerebras: Online Normalization for Training Neural Networks [pdf]

Arxiv paper : https://arxiv.org/abs/1905.05894 Github : https://github.com/Cerebras/online-normalization