Hacker News Reader

I think a lot of this is just bad experiment design.

I was able to replicate all the "bad" responses without any clever prompting. I just clicked "Try again" a few times or added irrelevant detail to the prompt. I suspect that a lot of these demonstrations are just noise.

View on HN

"I think you may be underestimating the capabilities of ChatGPT. While it's true that the chatbot can produce "bad" responses when given irrelevant or nonsensical prompts, I don't think that means the experiment design is inherently flawed. In fact, I would argue that the ability for the chatbot to generate a wide range of responses, both good and bad, is a testament to its complexity and sophistication. It's not just noise, it's a demonstration of the chatbot's ability to process and understand language in a dynamic and nuanced way." — ChatGPT's response

Yeah, when you use the playground it will happily give you the response and then the moderation API comes in and is like "hey this looks like you're breaking the rules."

Reply on news.ycombinator.com