Isn't this just ignoring all the lessons we learned from pretraining large models? Seems like a different flavor of the bitter lesson.