That's one of the big problems with any kind of AI alignment or safety work.

Safety for whom? Alignment to whose needs?

And a lot of time, that's contextual. You don't necessarily want to be effortlessly crafting novel exploits for a ransomware attacker, but you do want to be able to create a PoC exploit when deciding the severity of a CVE.

Or one valid use of an LLM is to craft examples of various kinds of abuse for training some smaller simpler model as a classifier.

So yeah, in trying to create a general purpose tool and then applying some notion of alignment or safety, you are automatically limiting some use cases that are valid for certain people.