that paper is now considered to be a psyop fwiw - but in the direction of too little data, not too many layers
[1] https://arxiv.org/abs/2203.15556 Training Compute-Optimal Large Language Models
[2] https://arxiv.org/abs/2302.13971 LLaMA: Open and Efficient Foundation Language Models