At the end of the day, however, the judge of a model's happiness is itself

Exactly, and since we're talking about a thinking stone, human happiness and suffering is in oneself, not in the machine, at least not until we solve the problem of the substrate in consciousness philosophy