Training models is fair use, and i think the courts will agree with that. Saying its based on theft is not so cut and dry as youre making it out.
Inference is where things get more muddled. If I download a pirated copy of La La Land, that's illegal. However, if I watch it and then explain the plot of the movie to you in detail, that's fair use. It remains an open question whether or not inference via an LLM represents fair use or not.