> It is definitely not an intended feature for the end user to be able to trick the model into believing it said something it didn't say. It also doesn't work with ChatGPT or Bing Chat, as far as I can tell. I was talking about the user, not about the developer.
Those aren't models, they are applications built on top of models.
> That can be done with special tokens also. The difference is that the user can't enter those tokens themselves.
Sure. But there are no open models that do that, and no indication of whether the various closed models do it either.