Hacker News Reader

They need to pretrain on fresh data.

or, they've had 4 for a long time (which they did). AFAIK they have had 5 for a while now too.

I'm not quite sure what their strategy is, because it looks like the models released just have tweaks on the same original training data, but nothing more. Basically, they decide not to release them and it doesn't seem to be a much different when they finally to decide to release.

Seems like a rushed RL run on top of an old model to jump into the hype train, seems reasonable since they hold a fantastic distribution moat. Even if it's not SOTA a billion people will use it and they'll collect data-points for future iterations. Same as muse.

Reply on news.ycombinator.com