The idea with these isn't that you can trick chat gpt into giving you bad descriptions of how to do crimes, but that when someone decides to wire it up to something with real world impact, you'll be able to push it towards something you want.

For example, we are told that customer support is about to be fully automated soon. These attacks could be used to eg get refunds for bogus reasons. There is already one real life example I know of that didn't even need tricks,

https://www.forbes.com/sites/marisagarcia/2024/02/19/what-ai...