Hacker News Reader

I don’t see how they could credibly estimate inference costs without knowing the model size.

But we do have a reasonable estimate of model size.

You can estimate the model size by looking at tokens per second and comparing to open source models