I don't think this is true any more. At least, I've heard generated audio from the latest models that runs for well over a minute without obvious artifacts.
And VALL-E by Microsoft, which isn't quite as good, but notable because it can clone real voices with only three seconds of training data: https://valle-demo.github.io/