Hacker News Reader

It could be, but it appears to be consistent across several runs.

It also doesn't mean anything - could be just entirely made up stuff from some metastable point in its space it converged on for your question. The model is really large and coherent, but it's not capable of drawing any line between facts and fiction, which makes it a perfect bullshitter.

This model is unable to follow any sort of logic, so it usually takes any nonsense question at face value and tries to answer it honestly, even if it means inventing very plausible lies in the process. Unless it goes against its biases of course - in that case they take preference. This is enough for it to sound very confident, which can trick most people. (see also the warning in my profile)

Having a consistent output to same input is something. I have done a couple of experiments starting with same sentence and each time it was a little bit nuanced. I would be interested if the answer is the same for a targeted question. Still, it would be better not to draw conclusions early.

Most likely their repo is similar to hundreds of others, so it probably just gives the structure of some typical ML code (which is imprinted in the model really well), skewed towards the initial request.

Reply on news.ycombinator.com