There's enough literature online, blog posts, textfiles on how to synthesize drugs, build your own weapons, but try prompting GPT, Gemini or any other major LLM out there you'd get a virtue signalling paragraph on why you're a bad person for even thinking about this.
Personally I don't care about this stuff, but in principle, the lack of the former points to LLMs being tweaked to be "safe".