That's just because we twisted it's arm. One could for example feed the reversed input after, ie abc|cba where | is a special token. That would allow it to react to any part of the message.
There is a recent paper from Meta that propose a way to train a model to backtrack its generation to improve generation alignment [0].