Hacker News Reader

"Fair thee well."

This sentence made me doubt the whole thing. That's not a mistake GPT-3 would make -- but a human would.

How can one know if GPT-3 really wrote something? Is there a starting seed or something that would allow the same response to follow the initial prompt? Or are we in positronic computing territory, beyond deterministic computing outcomes?

View on HN

>That's not a mistake GPT-3 would make -- but a human would.

Where did you think GPT learned it from? ;)

https://www.ruralmessenger.com/blogs/fair-thee-well-good-sir...

https://www.amazon.com/Fair-Thee-Well-Nathan-Jones/dp/069241...

https://www.amazon.com/Symphony-Fair-Thee-Well-Requiem/dp/B0...

https://soundcloud.com/ozwaldmusic/fair-thee-well

https://www.youtube.com/watch?v=yCIRgihMJlg

No doubt people make this mistake. But do you see other common spelling errors? I don't. Further, google n-grams show that "fare thee well" is orders of magnitude more common. So I'm skeptical this was machine generated.

GPT-3 isn't doing any thinking here. It's a glorified Markov Chain trained on the corpus of Reddit. Its output is pieces of random Reddit comments, mixed and matched to maximize the metric of "how likely are such words to appear after the prompt given".

It's neither anywhere as simple as a Markov Chain nor is the training dataset reddit comments (tho there are some in there).

Reply on news.ycombinator.com