That's not a great comparison. Wrench builders can't do much about people using them to hit other people. LLM builders can do a lot to prevent nudification attacks.

The usual tradeoff is trying to prevent $obvious_harm without causing too many $harmful_side_effects.

What are the harmful side effects of preventing nudification attacks?