With vision, pointing to Parti and DALLE as scaling is quite dumb. They perform similarly but are DRASTICALLY different in size. Parti has configurations with 350M, 750M, 3B, and 20B parameters. DALLE has 3.5. Imagen uses T5-XXL which alone has 11B parameters, just in the text part.
Not only this, there are major architecture changes. If scaling was all you needed then all these networks would still be using CNNs. But we shifted to transformers. THEN we have shifted to diffusion based models. Not to mention that Parti, DALLE, and Parti have different architectures. It isn't just about scale. Architecture matters here.
And to address concerns, diffusion (invented decades ago) didn't work because we just scaled it up. It worked because of engineering. It was largely ignored previously because no one got it to work better than GANs. I think this lesson should really stand out. That we need to consider the advantages and disadvantages of different architectures and learn how to make ALL of them work effectively. In that manner we can combine them to work in ideal ways. Even Le Cun is coming to this point of view despite previously being on the scaling side.
But maybe you NLP folks disagree. But the experience in vision is far more rich than just scaling.