This is a progress. ;) If I'm not mistaken biggest LLaMA used 2000 GPUs for 21 day.
Even the biggest vision models have traditionally been much smaller than even medium-sized "large" language models, so I don't think the comparison is purely apple to apple.