Hacker News Reader

That may be, but the weights you can download today were trained on 800B

I think they are “checkpoint” models in this case.

Will be fun to compare when completed!

Are not all models checkpoints? I think you may be interpreting it too colloquially.

yes of course that's why they use "will be trained" on the GH repo.