How do the "special tokens" work? Is this a completely reliable mechanism for delimiting the different parts of the prompt?
Are they guaranteed to be distinct from anything that could occur in the prompt, something like JavaScript's Symbol?
Or are they strings that are pretty likely not to occur in the prompt, something like a MIME boundary?
Or are they literally the strings "<|start|>" etc. used to denote them in the spec?