How does it differ from pirating music or movies?
Model outputs don't qualify for copyright. They aren’t patented. They aren’t trade secrets - the companies sell them. They aren’t trademarks, obviously. They are nothing, actually.
(and if you argue the US models do produce copyrighted works, then oooops - whose copyright is it huh?)