LLMs cannot create copyrightable works. Only humans can do that [0]. So LLMs are not making new copyrightable works.
[0] not because we're so amazingly more creative. But because copyright is a legal invention, not something derived from first principles, and has been defined to only apply to human creations. It could be changed to apply to LLM output in the future.