Hacker News Reader

Guaranteed to be fp16.

Or even lower, companies are experimenting with ternary, fp8, etc. for inference tasks.

This is explicitly for training, their first generation was for inference and used INT8 math.

Even for training? That would be disappointing.