Would it feel pain? And when? And how much?
Can we devise an AGI that feels intense pleasure when doing any kind of work?
Can we devise an AGI that feels intense pleasure when doing any kind of work?
For example, David Chalmers, who originated or developed many favorite anti-materialist positions (the 'hard problem', the explanatory gap, p-zombies) holds many positions that would normally be considered materialistic - for example, that if one were to replace a person's neurons with functionally-equivalent artificial devices, the resulting entity would still be conscious in the same way as the person we started with, and therefore, presumably, capable of feeling pain and pleasure. It would seem tendentious to hold this position and still assert that artificial conscious entities (complete with subjective experiences) are impossible.