Useless without comparing models with different settings. The same model with a different temperature, sampler, etc might as well be a different model.
Nearly all AI research does this whole “make big claims about what a model is capable of” and then they don’t do even the most basic sensitivity analysis or ablation study…