Perhaps they are/were going for stealth therapy-bot with this.
Empathy done well seems like 1:1 mapping at an emotional level, but that doesn’t imply to me that it couldn’t be done at a different level of modeling. Empathy can be done poorly, and then it is projecting.
Does one of these have a higher EQ, despite both being ink and paper and definitely not sentient?
Now, imagine they were produced by two different AIs. Does one AI demonstrate higher EQ?
The trick is in seeing that “EQ of a text response” is not the same thing as “EQ of a sentient being”
This is a designed system. The designers make choices. I don’t see how failing to plan and design for a common use case would be better.
= not to say that the people that work on AI are not incredibly talented, but more that it's not human
trainimg it topretend to be a feelingless robot or sympathetic mother are both weird to me. it should state facts with us.