Hacker News Reader

Exactly. The unstyled code snippets are the prompt: everything after that is generated by GPT-J-6B.

All the raw code outputs are available the GitHub repo to show there's no manipulation: https://github.com/minimaxir/gpt-j-6b-experiments

You should check out the interview with GPT-3; it’s impressive: https://www.youtube.com/watch?v=PqbB07n_uQ4

We can even solve math problems not because it’s programmed to but because it learned math by reading Wikipedia.

I wouldn't trust it to write any usable code, but maybe it could help me come up with beautifully elegant, poetic class and variable names.

I'd ask it: What would you name a function to destroy all humans, if you didn't want humans realizing what it was for when they read the code?

That's pretty cool. Imagine a world where as a software you just have to get the domain model and the architecture right, feed the knowledge graph to the transformer and let it generate a codebase. We can dream!