I'm somewhat minded to hedge bets that all AI outputs will ruled be non-copyrightable.
I know of a research team training against my TTS service. They've got five robots ingesting data now.
It's all ouroboros.
The bigger problem is they used the weights from Meta, which are possibly copyrightable in the US and likely copyrightable in the EU.
However chatGPT's term of service are explicit about disallowing people to use code generation from the model to train other models. Now, how enforceable that might be... that probably remains a matter for the courts.
But doing what these people have done is breaking the terms of service of the application.
We should not protect ideas from replication, only the expression should be copyrightable. Using data from another model extracts the ideas without the expression of the original training set, exactly following the idea/expression rule.