I think this should be taken down from HN, it's extremely misleading to anyone who might mistakenly believe that ChatGPT has self-knowledge.
>Previously, I pointed out aspects of ChatGPT that implied humans were helping craft the chatbot’s responses.
He links as a source an article where he gets ChatGPT to recall a detail from earlier in the current conversation, claims that is not a capability of ChatGPT, and insists that means there is a human editor involved.
But that is a capability of ChatGPT. It has limited local recall, with a small token budget, but it absolutely will remember the name of the fake company the author made up in their first question. That entire article lambasting the tech is based on a completely incorrect assumption, declared by the author with absolute confidence.
Edit: The author is not on twitter, there's no comment section or contact information provided. There's no means provided to even redress this analysis published on fallacious logic.
(Although FWIW it wouldn't surprise me if some of the "hall monitor" responses were pre written strings the model was tweaked to heavily favour using in response to certain prompts...)
Ironically, one of the easiest thing to spot that marks ChatGPT's responses as inhuman is its confidence in reporting something as factual and then when contradicted the way that it reports the opposite. In my experience, humans tend to put up more of a fight to defend their perspectives even when they are wrong.
This just comes down to the author being loose with their conclusions. It's unclear to me whether this is intentionally hyperbolic or satirical, or whether the author's claims are their actual beliefs. I'd lean towards the first explanation based on Eric Holloway's bio. But this is the real kicker that I'd disagree with:
> "Now, I have an explicit admission from the chatbot"
No, you have a language model's prediction of what would complete a conversation where you presented an idea and the model has sufficient data to write sentences that would conform to the idea rather than contradicting it. Given knowledge that this is how the responses work, inferring that the model is reporting any sort of accurate information must be inherently treated as suspect.
It's reasonably possible to lead the model down a path of conversation where the opposite idea is presented (that humans are not in the loop). That this is so indicates that this article is incorrect in it's stated conclusion (again assuming that it's not satire).