The crux of the debate is a motte and bailey.
AI is capable of reproducing copyright (motte) therefore training on copyright is illegal (bailey).
AI is capable of reproducing copyright (motte) therefore training on copyright is illegal (bailey).
Humans are capable of reproducing copyright illegally, but we allow them to train on copyrighted material legally.
Perhaps measures should be taken to prevent illegal reproduction, but if that's impossible, or too onerous, there should be utilitarian considerations.
Then the crux becomes a debate over utility, which often becomes a religious debate.