These exploits are fascinating. I like the examples in the GPT-4 System Card paper (https://cdn.openai.com/papers/gpt-4-system-card.pdf).