LLMs write. It sounds glib but it's what they do, and so every problem they encounter they will try to write their way out of it without lots of hand holding.
Yea I say something similar. LLMs have a tendency to add, because there are many more tokens than a stop token. They can remove, they can edit, but their bias is to add. My suspicion is that training them when to stop when it is best to stop is harder than training them to make a plausible sounding story.
they yearn to create content, generate more tokens, etc etc - agree