I was just looking at that! I know how these models work internally (), and I’d have said it’d not make a difference to use capslock. But then I see this prompt by OpenAI engineers and I’m like “they work then?”
() I know the basics of ML, NLP, transformers, etc. I know the theory, not even remotely close to how they really work.
Words with capital letters typically have higher token counts. This causes the LLM to apply attention differently.
Why would it not make a difference to use Caps Lock? It's fairly universally used in English to show emphasis.