As someone else has mentioned, just because weavers were/are passionate about what they do, that doesn't mean people shouldn't have been allowed to invent the loom + mass production techniques for clothing. Everyone on the planet has benefited mightily from this, and there are other similar examples.
Maybe there are restrictions that should be enforced to prevent this in some cases, or curtail it to some degree. There's likely not a one size fits all rule, and a lot of it is determined as net-good or net-bad in hindsight.
And yes, even a hobbiest has the right to make money off their work.
I won't comment on any of the potential legal differences between AI being trained on an artists work without their knowledge versus Jacquard studying hand-made clothmaking techniques. It's certainly something that needs careful consideration.