Hacker News Reader

It seems that the authors were using the "regular" GPT-4 API.

The model on the other side of that API has already been fine-tuned to not say that it is a human or a consciousness being, and I suspect that this fine-tuning interferes with their experiment regardless of the elaborate system prompts the authors supplied to it.

View on HN

This is a good point. We didn't have any cases of GPT-4 failing to try to pretend to be a human, although GPT-3.5 did this quite frequently.

I think RLHF causes other issues though (especially with the tone), and we're interested to try some non-RLHF'd open source models.

Reply on news.ycombinator.com