It would be great to see more focus on Chinchilla's result that most large models were quite undertrained with respect to optimal reduction in test loss.
agreed, we did not discuss that sufficiently
Hi! Great post. See my comment below about scaling down.
Thanks! I'll take a look, those do look interesting.