Hacker News Reader

It is very clearly a fake:

https://huggingface.co/burner22/numbat/discussions/13

Why clearly? You mean the tensor pre seed with deterministic pseudo random numbers? I don't have much experience in LLM training, but I do remember from minimization algorithms (like gradient descent) that it's better to start with (pseudo) random starting values and minimize from there. And seeing how I would like my results repeatable, seeding a pseudo random sequence seems logical.

I don't understand why these tensors specifically weren't changed during minimization (training) though. Maybe they were not activated, or a w part of an image decoder or something?

They weren't "changed" from random because it's not trained, it's a fake model with random weights, is what that post is implying.

How the heck did the model figure out the generation recipe? That's impressive in itself.

probably just

consider most naive possible way one would try to deceive users without exorbitant budget -> attempts a few things you naively would do -> recovers it by chance?

if that even is a valid signal though

I'm thinking it's the same model that was used to create the fake, so its "mind" went to the same place probabilistically.

Reply on news.ycombinator.com