Hacker News Reader

The training data is not so specifically filtered at least in pre training. The point is to give them as much world knowledge as possible

The OP is saying maybe that was a bad idea. I tend to agree given how badly these companies manage to sanitize outputs.

Because "put in all knowledge of chemistry that we have, except this specific recipe" isn't how knowledge works

May be they want to sell it to law enforcement as a model that can identify suspicious activities. It needs to know how and why something is suspicious to flag.

or its just lets gobble everything and figure out the guardrails later kind of approach.