You look at it in binary categories, but instead, it is always some amount of information and some amount of randomness. An LLM can predict emotions similarly to words. Emotions and social dynamics from an LLM are as valid as the words it speaks. Most of the time, they are correct, but sometimes they are not.
The real difference is that LLMs can be trained to cope with emotions much better ;-)
Well, at least to some extent. I mean, changing the inner state of an AI (as they are being built today) certainly is, because it does not affect other beings. However, the interaction might change your inner state. Like looking at an AI-generated image and finding it beautiful or awful. Similarly, talking to Miles or Maya might let you feel certain emotions.
I think that part can be very meaningful, but I also agree that current AI is built to not carry its emotional state into the world outside of the direct interaction.