Any automated process for generating training data is part of the model, not part of the training data.
Authentic human generated information has irreducible newness.
Authentic human generated information has irreducible newness.
I believe that point is open to debate.
Think language change every 1000 years. Would AI adapt to that? What new training data would it require? Surely obviously it would require some new inputs. It surely requires internet connected speakers of the developing language.
I think the “surely it would require new inputs” is enough to favour the irreducible newness point.
“Irreducible newness” may be just overhyped “changing relevancy” though, that’s what I’m stuck on.
Sure, a style like cubism is unlikely to appear from current AI art generation, but ultimately there's a human still in the loop. The human picks the direction the generation goes in and you can definitely see "styles" or even "characters" appear in certain types of prompts.
If you hang around people that do this a lot you'll see that some of them end up generating hundreds, if not thousands, of images of what seems to be the same character in varying situations. That indicates to me that you could potentially find a type of prompt that would lead to an art movement.
Hell, AI art itself might constitute an art movement.
"Human brain is magic." <> "Human brain is not simulatable by Turing machines."
There are other possibilities. I'm sure you can think of a few.