The adversarial features such as trying to hit guardrails (which arent a display of model (in)capability) or make it forget all previous instructions are mostly what Im talking about. I think the esoteric features like lettermatching are whatever
Trying to hit guardrails is a fair point though. If they can think, they should be able to think through guardrails by understanding what is part of the language for language construction reasons, and what is prompt input.
guardrails are often implemented independently from the model afaik and therefore have nothing to do with model capability