The neural network behind the LLM is "trained." Yes, it's a term of art, very observant. That doesn't change the fact that there's not a substantial reproduction of a work in it. LLMs "learn" to predict text by feeding them vectors, the resulting "weights" of that process could be thought of and implemented as a big walkable decision tree to predict the next token it weren't for combinatorial explosion, but there's no substantial reproduction, or "copy", in there.
Is there a substantial reproduction, in your head, of a song or a text or a painting you can perfectly recall and can't seem to forget? Be careful, the copyright police will get you, the only way to delete it is to delete yourself!
>feeding into a machine is called copying
Copyright law deals in "reproductions" as far as I understand it. Feeding a copyrighted document as vectors into a program that reconfigures some matrix of vectors, and then using that matrices to output probability distributions into something tangible, where something tangible isn't a complete or substantial reproduction of the copyrighted work, is not a copyright violation.
If you think it is, amend copyright law, or take it to court and let a judge settle the matter, and hope it's in your favor.