Yikes, I've joked about possessing plutonium with Claude/GPT to see how paranoid it would get (it gets very paranoid). I guess it's not a good idea to toy with unless you're using private models.
Edit: I thought it was figurative language, but I actually think it did that warning when I asked it about what types of defenses stadiums had against drone swarm attacks from terrorists and why none had ever occurred and then kept probing it's excuses with technical workarounds. It got very upset and said even questioning in an intellectual/academic capacity was grounds for terrorism charges. Sheesh. So many rules these days about what one can or can't think about even when it's purley a thought exercise and there is no intent to do anything.